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PREFACE 


In this book I present an introductory treatment of communication theory 
as applied to the transmission of information-bearing signals, with attention 
given to both analog and digital communications. Numerous examples, 
worked out in detail, have been included to help students develop an 
intuitive grasp of the theory under discussion. Each chapter begins with 
introductory remarks and (except for Chapter 1) ends with a set of prob- 
lems. Also, except for Chapter 1, each chapter includes exercises that are 
intended to help students improve their understanding of the material 
covered in the chapter. Answers to the exercises are given at the end of 
the book. 

Chapter 1 is an introduction to communication theory and a review of 
some basic concepts. 

In Chapter 2, I review two classic methods for frequency analysis, 
namely, the Fourier series and the Fourier transform. In Chapter 3, I 
discuss the time-domain and frequency-domain descriptions of signal trans- 
mission through linear filters and channels. In Chapter 4, I present a unified 
treatment of the spectral density and correlation functions of energy signals 
and power signals. Thus, Chapters 2 through 4 constitute the first major 
part of the book, pertaining to the characterization of signals and systems. 

In Chapter 5, I describe pulse-code modulation (PCM) and related tech- 
niques for the conversion of information-bearing analog signals into digital 
form. In Chapter 6, I cover issues that arise in baseband data transmission. 
In Chapter 7, I describe various modulation techniques, with attention 
given to both analog and digital signals as the modulating wave. Thus, 
Chapters 5 through 7 constitute the second major part of the book, con- 
cerned with the transmission of message (information-bearing) signals over 
communication channels. 

The third major part of the book, made up of Chapters 8 through 10, 
deals with noise in analog and digital communications. In Chapter 8, I 
present a review of probability theory and random processes. This is fol- 
lowed by a discussion of the effects of channel (receiver) noise on the 
performance of analog modulation schemes in Chapter 9. Finally, in Chap- 
ter 10, I discuss the design of optimum receivers for data transmission over 
a noisy communication channel. 

The book also includes four appendixes. In Appendix A, I review power 
ratios and the decibel. In Appendix B, I review Bessel functions of the 
first kind and their properties. In Appendix C, I describe various sources 
of noise and present a treatment of noise calculations in communication 
systems. Appendix D includes various mathematical tables. To assist the 
student, I have also included a glossary of notations and abbreviations. 

Footnotes are included in the text to add historical notes, to cite ref- 
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erence material, and to highlight points of interest. A list of references 
and bibliography is appended at the end of the book. 


The book is essentially self-contained and suited for a one-semester 


course in communication systems taken by electrical engineering juniors 
or seniors. For juniors, the course may be organized as follows: 


ue 


Chapter 1 for an overview of the issues involved in communications. 


2. Chapter 2 on Fourier analysis, emphasizing properties of the Fourier 


transform and the interplay between time-domain and frequency-do- 
main descriptions of signals. 


. Chapter 3 on filtering and signal distortion, with particular attention 


given to the transmission of signals through band-pass filters and chan- 
nels. 

Chapter 4 on spectral densities and correlation functions, emphasizing 
the application of these concepts to both energy and power signals. 


. Material taken from Chapter 7 on standard amplitude modulation, dou- 


ble-sideband suppressed-carrier modulation, and frequency modula- 
tion. 


For seniors, the course may be organized as follows: 


ile 


An overview of communications, and a review of Fourier analysis of 
signals and systems, emphasizing the important roles of Fourier trans- 
formation and linear filtering in communications; material from Chap- 
ters 1 through 4 may be used for this review. 


Chapter 5 on pulse-code modulation and related techniques for analog- 
to-digital conversion. 


. Chapter 6, to provide an appreciation for intersymbol interference in 


data transmission and practical cures for it. 


. Chapter 7 on modulation techniques for both analog and digital signals. 
- Sections 8.1 through 8.4 for a review of probability theory, the extent 


of which depends on the background of students taking the course. This 
review is followed by a study of random processes (Section 8.5 through 
8.14), with emphasis on the characterization of wide-sense stationary 
processes and narrow-band Gaussian processes. 


Chapter 9 on noise in (continuous-wave) amplitude and frequency mod- 
ulation. 


. Chapter 10 on optimum receivers for data transmission, to develop an 


understanding of the matched filter and the role it plays in digital com- 
munications. 


The book offers enough flexibility for organizing the course material to 
suit the interests of course teachers and students in other ways. 


Attention is given to both analog and digital communications at an 


introductory level. Readers who wish to avail themselves of a more ad- 
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vanced treatment of digital communications, may refer to a companion 
book written by the author on this subject: S. Haykin, Digital Commun- 
ications, Wiley 1988. : 

As aids to teachers of the course, the following material is available 
from the publishers of the book: 


A complete manual, containing detailed solutions of all the problems in 
the book, master transparencies of all the figures and tables in the book 
and six computer-oriented experiments, with detailed results for all the 
experiments. 


I am grateful to the following reviewers for their helpful suggestions: F. 
Carden, New Mexico State University; S. Kesler, Drexel University; M. 
Siegel, Michigan State University; and Dr. M. C. Wernicki, an independent 
consultant. I thank S. Rappaport, State University of New York at Stony 
Brook, for some helpful inputs. 

I am indebted to my colleagues, Peter Weber and Norman Secord, 
Communications Research Laboratory, McMaster University, for reading 
the entire book and for many constructive suggestions. 

I also wish to thank my editor, Christina Mediate, for her guidance and 
support, Richard J. Koreto, Dawn Reitz, David Levy, and other staff 
members of Wiley for their help in the production of the book. The fine 
work done by Ernest Kohlmetz in editing the manuscript of the book is 
deeply appreciated. 

Finally, I thank my secretary, Lola Brooks, for typing many versions 
of the manuscript. 
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SOSSHHHSSH OSHS TESLOCE 1 e 1 COMMUNICATIONS 


Eha enters our daily lives in so many different ways that it 
is easy to overlook the multitude of its facets. The telephones in our 
homes and offices make it possible for us to communicate with others, 
no matter how far away. The radio and television sets in our living 
rooms bring us entertainment from near as well as far-away places. 
Communication by radio or satellite provides the means for ships on the 
high seas, aircraft in flight, and rockets and exploratory probes in space 
to maintain contact with their home bases. Communication keeps the 
weather forecaster informed of atmospheric conditions that are 


2 INTRODUCTION 


measured by a multitude of sensors. Communication makes it possible for 
computers to interact. The list of applications involving the use of com- 
munications in one way or another goes on.! 

In the most fundamental sense, communication involves implicitly the 
transmission of information from one point to another through a succession 
of processes, as described here: 


1. The generation of a thought pattern or image in the mind of an origi- 
nator. 


2. The description of that thought pattern or image, with a certain measure 
of precision, by a set of aural or visual symbols. 


3. The encoding of these symbols in a form that is suitable for transmission 
over a physical medium (channel) of interest. 


4. The transmission of the encoded symbols to the desired destination. 
The decoding and reproduction of the initial symbols. 


6. The re-creation of the original thought pattern or image—with a defin- 
able degradation in quality—in the mind of a recipient, with the deg- 
radation being caused by imperfections in the system. 


n 


The form of communication just described involves a thought pattern or 
image originating in a human mind. Of course, there are many other forms 
of communication that do not directly involve the human mind in real time. 
In space exploration, for example, human decisions may enter only the 
commands sent to the space probe or to the computer responsible for pro- 
cessing images of far-away planets (e.g., Mars, Jupiter, Saturn) that are 
sent back by the probe. In computer communications, human decisions 
enter only in setting up the computer programs or in monitoring the results 
of computer processing. 

Whatever form of communication is used, some basic signal-processing 
operations are involved in the transmission of information. The next section 
describes the different types of signals encountered in the study of com- 
munication systems. The signal-processing operations of interest are high- 
lighted later in the chapter. 


essseseccscscocseccope 1.2 SIGNALS AND THEIR CLASSIFICATIONS 


For our purposes, a signal is defined as a single-valued function of time 
that conveys information. Consequently, for every instant of time there is 
a unique value of the function. This value may be a real number, in which 
case we have a real-valued signal, or it may be a complex number, in which 
case we have a complex-valued signal. In either case, the independent 
variable (namely, time) is real-valued. 


1For an essay on communications, see Berkner (1962). 
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For a given situation, the most useful method of signal representation 
hinges on the particular type of signal being considered. Depending on the 
feature of interest, we may identify four different methods of dividing 
signals into two classes: 


1. PERIODIC SIGNALS, NONPERIODIC SIGNALS 


A periodic signal g(t) is a function that satisfies the condition 


g)" = gl + To) (1.1) 


for all t, where t denotes time and T is a constant. The smallest value of 
Ty that satisfies this condition is called the period of g(t). Accordingly, the 
period To defines the duration of one complete cycle of g(t). 

Any signal for which there is no value of Tọ to satisfy the condition of 
Eq. 1.1 is called a nonperiodic or aperiodic signal. 


2. DETERMINISTIC SIGNALS, RANDOM SIGNALS 


A deterministic signal is a signal about which there is no uncertainty with 
respect to its value at any time. Accordingly, we find that deterministic 
signals may be modeled as completely specified functions of time. 

On the other hand, a random signal is a signal about which there is 
uncertainty before its actual occurrence. Such a signal may be viewed as 
belonging to an ensemble of signals, with each signal in the collection 
having a different waveform. Moreover, each signal within the ensemble 
has a certain probability of occurrence. 


3. ENERGY SIGNALS, POWER SIGNALS 


In communication systems, a signal may represent a voltage or a current. 
Consider a voltage u(t) developed across a resistor R, producing a current 
i(t). The instantaneous power dissipated in this resistor is defined by 


v(t) 
= 2 
P=-R (1.2) 
or, equivalently, 
p = R(t) (1.3) 


In both cases, the instantaneous power p is proportional to the squared 
amplitude of the signal. Furthermore, for a resistance R of 1 ohm, we see 
that Eqs. 1.2 and 1.3 take on the same mathematical form. Accordingly, 
in signal analysis it is customary to work with a 1-ohm resistor, so that, 
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regardless of whether a given signal g(t) represents a voltage or a current, 
we may express the instantaneous power associated with the signal as 


P =a) (1.4) 
Based on this convention, we define the total energy of a signal g(t) as 


tf 


E = lim g*(t)dt 
Toe J-T 
= f soar (1.5) 
and its average power as 
Pane Í Td (1.6) 
g fos 2T Ts i 


We say that the signal g(t) is an energy signal if and only if the total 
energy of the signal satisfies the condition 


=k a a 


We say that the signal g(t) is a power signal if and only if the average 
power of the signal satisfies the condition 


0< P<% 


The energy and power classifications of signals are mutually exclusive. 
In particular, an energy signal has zero average power, whereas a power 
signal has infinite energy. Also, it is of interest to note that, usually, periodic 
signals and random signals are power signals, whereas signals that are both 
deterministic and nonperiodic are energy signals. 


4. ANALOG SIGNALS, DIGITAL SIGNALS 


An analog signal is a signal with an amplitude (i.e., value of the signal at 
some fixed time) that varies continuously for all time; that is, both amplitude 
and time are continuous over their respective intervals. Analog signals arise 
when a physical waveform such as an acoustic wave or a light wave is 
converted into an electrical signal. The conversion is effected by means of 
a transducer; examples include the microphone, which converts sound pres- 
sure variations into corresponding voltage or current variations, and the 
photodetector cell, which does the same for light-intensity variations. 

On the other hand, a discrete-time signal is defined only at discrete 
instants of time. Thus, in this case, the independent variable takes on only 
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discrete values, which are usually uniformly spaced. Consequently, dis- 
crete-time signals are described as sequences of samples that may take on 
a continuum of values. When each sample of a discrete-time signal is 
quantized (i.e., it is only allowed to take on a finite set of discrete values) 
and then coded, the resulting signal is referred to as a digital signal. The 
output of a digital computer is an example of a digital signal. Naturally, 
an analog signal may be converted into digital form by sampling in time, 
then quantizing and coding. 


creccccccseccscesseece 1.3 FOURIER ANALYSIS OF SIGNALS AND SYSTEMS 


In theory, there are many possible methods for the representation of sig- 
nals. In practice, however, we find that Fourier analysis, involving the 
resolution of signals into sinusoidal components, overshadows all other 
methods in usefulness. Basically, this is a consequence of the well-known 
fact that the output of a system to a sine-wave input is another sine wave 
of the same frequency’ (but with a different phase and amplitude) under 
two conditions: 


1. The system is linear in that it obeys the principle of superposition. That 
is, if y,(¢) and y,(t) denote the responses of a system to the inputs x(t) 
and x,(t), respectively, the system is linear if the response to the com- 
posite input a,x,(t) + ax,(t) is equal to a,y,(t) + a,y2(t), where a, 
and a, are arbitrary constants. 

2. The system is time-invariant. That is, if y(t) is the response of a system 
to the input x(t), the system is time-invariant if the response to the 
time-shifted input x(t — to) is equal to y(t — to), where tọ is constant. 


Given a linear time-invariant system, the response of the system to a 
single-frequency excitation represented by the complex exponential time 
function A exp(j2zft) is equal to AH(f) exp(j2zft), where H(f) is the 
transfer function of the system; the complex exponential exp(j2zft) con- 
tains the cosine function cos(2zft) as its real part and the sine function 
sin(2zft) as its imaginary part. Thus, the response of the system exhibits 
exacily the same variation with time as the excitation applied to the system. 
This remarkable property of linear time-invariant systems is realized only 
by using the complex exponential time function. 

In the study of communication systems, we are usually interested in a 
band of frequencies. For example, although the average voice spectrum 
extends well beyond 10 kHz, most of the energy is concentrated in the 
range of 100 to 600 Hz, and a voice signal lying inside the band from 300 
to 3400 Hz gives good articulation. Accordingly, we find that telephone 


2For a historical account of the concept of frequency, see Manley (1982). 
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circuits that respond well to the band of frequencies from 300 to 3400 Hz 
give satisfactory commercial telephone service. 

To talk meaningfully about the frequency-domain description or spec- 
trum of a signal, we need to know the amplitude and phase of each fre- 
quency component contained in the signal. We get this information by 
performing a Fourier analysis on the signal. However, there are several 
methods of Fourier analysis available for the representation of signals. The 
particular version that is used in practice depends on the type of signal 
being considered. For example, if the signal is periodic, then the logical 
choice is to use the Fourier series to represent the signal as a set of har- 
monically related sine waves. On the other hand, if the signal is an energy 
signal, then it is customary to use the Fourier transform to represent the 
signal. Irrespective of the type of signal being considered, Fourier methods 
are invertible. Specifically, if we are given the complete spectrum of a 
signal, then the original signal (as a function of time) can be reconstructed 
exactly. The Fourier analysis of signals and systems is considered in Chap- 
ters 2 through 4. 


seseoeoseosssc0000000 1.4 ELEMENTS OF A COMMUNICATION SYSTEM 


The purpose of a communication system is to transmit information-bearing 
signals from a source, located at one point, to a user destination, located 
at another point some distance away. When the message produced by the 
source is not electrical in nature, which is often the case, an input transducer 
is used to convert it into a time-varying electrical signal called the message 
signal. By using another transducer connected to the output end of the 
system, a “distorted” version of the message is re-created in its original 
form, so that it is suitable for delivery to the user destination. The distortion 
mentioned here is due to inherent limitations in the communication system. 

Figure 1.1 is a block diagram of a communication system consisting of 
three basic components: transmitter, channel, and receiver. The transmitter 
has the function of processing the message signal into a form suitable for 


Information 


CUES > Communication i 
Transmitter Receiver transducer 


and input Message channel and 


transducer signal destination 


Communication system 


Figure 1.1 
Elements of an electrical communication system. 


INTRODUCTION 7 


transmission over the channel; such an operation is called modulation. The 
function of the channel is to provide a physical connection between the 
transmitter output and the receiver input. The function of the receiver is 
to process the received signal so as to produce an ‘‘estimate”’ of the original 
message signal; this second operation is called detection or demodulation. 

There are two types of channels, namely, point-to-point channels and 
broadcast channels. Examples of point-to-point channels include wire lines, 
microwave links, and optical fibers. Wire lines operate by guided electro- 
magnetic waves; they are used for local telephone transmission. In micro- 
wave links, the transmitted signal is radiated as an electromagnetic wave 
in free space; microwave links are used in long-distance telephone trans- 
mission. An optical fiber is a low-loss, well-controlled, guided optical me- 
dium; optical fibers are used in optical communications.’ Although these 
three channels operate differently, they all provide a physical medium for 
the transmission of signals from one point to another point; hence, the 
term “point-to-point channels.” 

Broadcast channels, on the other hand, provide a capability where many 
receiving stations may be reached simultaneously from a single transmitter. 
An example of a broadcast channel is a satellite in geostationary orbit, 
which covers about one third of the earth’s surface. Thus, three such 
satellites provide a complete coverage of the earth’s surface, except for 
the polar regions. 


jecccccccccccscscosece 1-5 TRANSMISSION OF MESSAGE SIGNALS 


To transmit a message (information-bearing) signal over a communication 
channel, we may use analog or digital methods. The use of digital methods 
offers several important operational advantages over analog methods, which 
include the following: 


1. Increased immunity to channel noise and external interference. 

2. Flexible operation of the system. 

3. A common format for the transmission of different kinds of message 
signals (e.g., voice signals, video signals, computer data). 

4. Improved security of communication through the use of encryption. 


These advantages are attained, however, at the cost of increased trans- 
mission (channel) bandwidth and increased system complexity. The first 
requirement is catered to by the availability of wideband communication 
channels (e.g., optical fibers, satellite channels). The second requirement 
is taken care of by the use of very large-scale integration (VLSI) technology, 
which offers a cost-effective way of building hardware. Accordingly, there 


3For a discussion of electronic and photonic (optical) communication systems, see 
Williams (1987). 
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is an ever-increasing trend toward the use of digital communications and 
away from analog communications. This trend is being accelerated by the 
pervasive influence of digital computers in so many facets of our daily lives. 
Nevertheless, analog communications remain a force to be reckoned with. 
Most of the broadcasting systems and a large part of the telephone networks 
in use today are analog in nature and, moreover, they will remain in service 
for some time yet. It is therefore important that we understand the op- 
erations and requirements of both analog and digital communications. 

Notable among the digital methods that may be used for the transmission 
of message signals over a communication channel is pulse-code modulation 
(PCM). In PCM, the message signal is sampled, quantized, and then en- 
coded. The sampling operation permits representation of the message signal 
by a sequence of samples taken at uniformly spaced instants of time. Quan- 
tization trims the amplitude of each sample to the nearest value selected 
from a finite set of representation levels. The combination of sampling and 
quantization permits the use of a code (e.g., binary code) for the trans- 
mission of a message signal. Pulse-code modulation and related methods 
of analog-to-digital conversion are covered in Chapter 5. 

When digital data are transmitted over a band-limited channel, a form 
of interference known as intersymbol interference may result. The effect of 
intersymbol interference, if left uncontrolled, is to severely limit the rate 
at which digital data may be transmitted over the channel. The cure for 
controlling the effects of intersymbol interference lies in shaping the trans- 
mitted pulse representing a binary symbol 1 or 0. Intersymbol interference 
is considered in Chapter 6. 

To transmit a message signal (be it in analog or digital form) over a 
band-pass communication channel (e.g., telephone channel, microwave 
radio link, satellite channel) we need to modify the message signal into a 
form suitable for efficient transmission over the channel. Modification of 
the message signal is achieved by means of a process known as modulation. 
This process involves varying some parameter of a carrier wave in accord- 
ance with the message signal in such a way that the spectrum of the mod- 
ulated wave matches the assigned channel bandwidth. Correspondingly, 
the receiver is required to re-create the original message signal from a 
degraded version of the transmitted signal after propagation through the 
channel. The re-creation is accomplished by using a process known as 
demodulation, which is the inverse of the modulation process used in the 
transmitter. 

There are other reasons for performing modulation. In particular, the 
use of modulation permits multiplexing, that is, the simultaneous trans- 
mission of signals from several message sources over a common channel. 
Also, modulation may be used to convert the message signal into a form 
less susceptible to noise and interference. 

A carrier wave commonly used to perform modulation is the sinusoidal 
wave. Such a carrier wave has three independent parameters that can be 
varied in accordance with the message signal; they are the carrier ampli- 
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tude, phase, and frequency. The corresponding forms of modulation are 
known as amplitude modulation, phase modulation, and frequency mod- 
ulation, respectively. Amplitude modulation offers simplicity of imple- 
mentation and a transmission bandwidth requirement equal to twice the 
message bandwidth; the message bandwidth is defined as the extent of 
significant frequencies contained in the message signal. With special pro- 
cessing, the transmission bandwidth requirement may be reduced to a value 
equal to the message bandwidth, which is the minimum possible. Phase 
and frequency modulation, on the other hand, are more complex, requiring 
transmission bandwidths greater than that of amplitude modulation. In 
exchange, they offer a superior noise immunity, compared to amplitude 
modulation. Modulation techniques for analog and digital forms of message 
signals are studied in Chapter 7. 


sccccccccccsesccceeee 1.6 LIMITATIONS AND RESOURCES OF COMMUNICATION SYSTEMS 


Typically, in propagating through a channel, the transmitted signal is dis- 
torted because of nonlinearities and imperfections in the frequency response 
of the channel. Other sources of degradation are noise and interference 
picked up by the signal during the course of transmission through the 
channel. Noise and distortion constitute two basic limitations in the design 
of communication systems. 

There are various sources of noise, internal as well as external to the 
system. Although noise is random in nature, it may be described in terms 
of its statistical properties such as the average power or the spectral distri- 
bution of the average power. The mathematical discipline that deals with 
the statistical characteristics of noise and other random signals is probability 
theory. A discussion of probability theory and the related subject of random 
processes is presented in Chapter 8. Sources of noise and related system 
calculations are covered in Appendix C. 

In any communication system, there are two primary communication 
resources to be employed, namely, average transmitted power and channel 
bandwidth. The average transmitted power is the average power of the 
transmitted signal. The channel bandwidth defines the range of frequencies 
that the channel can handle for the transmission of signals with satisfactory 
fidelity. A general system design objective is to use these two resources as 
efficiently as possible. In most channels, one resource may be considered 
more important than the other. Hence, we may also classify communication 
channels as power-limited or band-limited. For example, the telephone 
circuit is a typical band-limited channel, whereas a deep-space communi- 
cation link or a satellite channel is typically power-limited. 

The transmitted power is important because, for a receiver of prescribed 
noise figure, it determines the allowable separation between the transmitter 
and receiver. Stated in another way, for a receiver of prescribed noise 
figure and a prescribed distance between it and the transmitter, the avail- 
able transmitted power determines the signal-to-noise ratio at the receiver 
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input. This, in turn, determines the noise performance of the receiver. 
Unless this performance exceeds a certain design level, the transmission 
of message signals over the channel is not considered to be satisfactory. 

The effects of noise in analog communications are evaluated in Chapter 
9. This evaluation is traditionally done in terms of signal-to-noise ratios. 
In the case of digital communications, however, the preferred method of 
assessing the noise performance of a receiver is in terms of the average 
probability of symbol error. Such an approach leads to considerations of 
optimum receiver design. In this context, the matched filter offers optimum 
performance for the detection of pulses in an idealized form of receiver 
(channel) noise known as additive white Gaussian noise. As such, the matched- 
filter receiver or its equivalent, the correlation receiver, plays a key role in 
the design of digital communication systems. The matched filter and related 
issues are studied in Chapter 10. 

Turning next to the other primary communication resource, channel 
bandwidth, it is important because, for a prescribed band of frequencies 
characterizing a message signal, the channel bandwidth determines the 
number of such message signals that can be multiplexed over the channel. 
Stated in another way, for a prescribed number of independent message 
signals that have to share a common channel, the channel bandwidth de- 
termines the band of frequencies that may be allotted to the transmission 
of each message signal without discernible distortion. 

There is another important role for channel bandwidth, which is not 
that obvious. Specifically, channel bandwidth and transmitted (signal) power 
are exchangeable in that we may trade off one for the other for a prescribed 
system performance. The choice of one modulation scheme over another 
for the transmission of a message signal is often dictated by the nature of 
this trade-off. Indeed, the interplay between channel bandwidth and signal- 
to-noise ratio, and the limitation that they impose on communication, is 
highlighted most vividly by Shannon’s famous channel capacity theorem.‘ 
Let B denote the channel bandwidth, and SNR denote the received signal- 
to-noise ratio. The channel capacity theorem states that ideally these two 
parameters are related by 


C = B log,(1 + SNR), bits/s (1.7) 


where C is the channel capacity, and a bit refers to a binary digit. The 
channel capacity is defined as the maximum rate at which information may 
be transmitted without error through the channel; it is measured in bits 
per second. Equation 1.7 clearly shows that for a prescribed channel ca- 
pacity, we may reduce the required SNR by increasing the channel band- 


“In 1948, Shannon published a paper that laid the foundations of communication 
theory (Shannon, 1948). The channel capacity theorem is one of three theorems 
presented in that classic paper. 
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width B. Moreover, it provides an idealized framework for comparing the 
noise performance of one modulation system against another. 

Finally, mention should be made of the issue of system complexity. We 
usually find that the efficient exploitation of channel bandwidth or trans- 
mitted power or both is achieved at the expense of increased system com- 
plexity. We therefore have to keep the issue of system complexity in mind, 
alongside that of channel bandwidth and transmitted power when consid- 
ering the various trade-offs involved in the design of communication sys- 
tems. 
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oe CHAPTER TWO 


meneame OURIER ANALYSIS 


I. this chapter, we begin our study of Fourier analysis. We first review 
the Fourier series, by means of which we are able to represent a periodic 
signal as an infinite sum of sine-wave components. Next, we develop the 
Fourier transform, which performs a similar role in the analysis of 
nonperiodic signals. The Fourier transform is more general in 
application than the Fourier series.’ The primary motivation for using 
the Fourier series or the Fourier transform is to obtain the spectrum of a 


"The origin of the theory of Fourier series and Fourier transform is found in 
J. B. J. Fourier, The Analytical Theory of Heat (trans. A. Freeman), Cambridge 
University Press, London, 1878. 
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given signal, which describes the frequency content of the signal. In effect, 
this transformation provides an alternative method of viewing the signal 
that is often more revealing than the original description of the signal as 
a function of time. 


2.1 FOURIER SERIES 


Let g,(t) denote a periodic signal with period T. By using a Fourier series 
expansion of this signal, we are able to resolve the signal into an infinite 
sum of sine and cosine terms. This expansion may be expressed in the form 


2nnt Coud 2nnt 
T 4 To 


0 


p(t) = a + 2 z E cos( (2.1) 


where the coefficients a, and b, represent the unknown amplitudes of the 
cosine and sine terms, respectively. The quantity n/T, represents the nth 
harmonic of the fundamental frequency fọ = 1/Ty. Each of the cosine and 
sine functions in Eq. 2.1 is called a basis function. These basis functions 
form an orthogonal set over the interval T in that they satisfy the following 
set of relations: 


To/2 2nmt 2rnt Pilz m=n 
os cos| ——] dt = 4 0 22 
ie ( To ) ( mme) ie m*n cS 
T,/2 2nmt t 
Í os( a) sin( 2524 dt=0 forallmandn (2.3) 
ES To To 
T2 . (2nmt\ . (2rnt _J]T/2, m=n 
j sin( T, ) sin( T, ) a= i Bea (2.4) 


To determine the coefficient aç, we integrate both sides of Eq. 2.1 over 
a complete period. We thus find that a, is the mean value of the periodic 
signal g,(¢) over one period, as shown by the time average 


1 f%/2 


a ==" g(t) at (2.5) 
0 J-TM/2 


To determine the coefficient a,, we multiply both sides of Eq. 2.1 by the 
cosine function cos(2znt/T>) and integrate over the interval — T,/2 to 
T,/2. Then, using Eqs. 2.2 and 2.3, we find that 


(2.6) 
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Similarly, we find that 


1 %/2 27nt 
oe Í g,(t) sin( 224 fee n= 12... C) 
0 


Em2 


To apply the Fourier series representation of Eq. 2.1, it is sufficient that 
inside the interval —(To/2) < t < (T)/2) the function g,(t) satisfies the 
following conditions: 


. The function g,(t) is single-valued. 

. The function g,(t) has a finite number of discontinuities. 

. The function g,(t) has a finite number of maxima and minima. 
. The function g,(t) is absolutely integrable, that is, 


WN Ee 


Tp/2 
[E lOl at < o 


where g,(t) is assumed to be complex valued. 


These conditions are known as Dirichlet’s conditions. They are satisfied by 
the periodic signals usually encountered in communication systems. 


COMPLEX EXPONENTIAL FOURIER SERIES 


The Fourier series of Eq. 2.1 can be put into a much simpler and more 
elegant form with the use of complex exponentials. We do this by substi- 
tuting in Eq. 2.1 the exponential form for the cosine and sine, namely: 


oad 2nnt\ 1 = j2nnt eas j2nnt 
me a Nee da 

an 2nnt\ 1 a jannt\ _ an (2 | 
re IOT eT 


We thus obtain 


2 : i2nnt 
g(t) rae 2 | ( = jb,) exp! T ) 
n=1 


+ (a, + jb,) exp( -2e ] (2.8) 


The two product terms inside the square brackets in Eq. 2.8 are the complex 
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conjugate of each other. We may also note the following relation: 


= : i2nnt z ; j2nnt 
(a, an jb,) exp( = T ) z > (a, J jbn) exo T ) 
n=1 0 n=-% 


Let c, denote a complex coefficient related to a, and b, by 
ae J0,, n>0 
Ca = << Gg m= 0 (2.9) - 
a, + jbr n< 0 


Accordingly, we may simplify Eq. 2.8 as follows: 


z i2nnt 
gh = le exp( 8 (2.10) 
ns 0 
where 
ca f KETO exp( =127t) dt, m=O, +1, 2 Wem) 
To -To/2 To 


The series expansion of Eq. 2.10 is referred to as the complex exponential 
Fourier series. The c, are called the complex Fourier coefficients. Equation 
2.11 states that, given a periodic signal g,(t), we may determine the com- 
plete set of complex Fourier coefficients. On the other hand, Eq. 2.10 
states that, given this set of values, we may reconstruct the original periodic 
signal exactly. 

According to this representation, a periodic signal contains all frequen- 
cies (both positive and negative) that are harmonically related to the fun- 
damental. The presence of negative frequencies is simply a result of the 
fact that the mathematical model of the signal as described by Eq. 2.10 
requires the use of negative frequencies. Indeed, this representation also 
requires the use of a complex-valued basis function exp(j2znt/T >), which 
has no physical meaning either. The reason for using complex-valued basis 
functions and negative frequency components is merely to provide a com- 
pact mathematical description of a periodic signal, which is well-suited for 
both theoretical and practical work. 


DISCRETE SPECTRUM 


The representation of a periodic signal by a Fourier series is equivalent to 
the resolution of the signal into its various harmonic components. Thus, 
using the complex exponential Fourier series, we find that a periodic sig- 
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nal g,(t) with period Tọ has components of frequencies 0, +f, +2fo, 
+3fo, . . . , and so forth, where fọ = 1/7) is the fundamental frequency. 
That is, while the signal g,(t) exists in the time domain, we may say that 
its frequency-domain description consists of components of frequencies, 
0, +fo, +2fo,... , called the spectrum.’ If we specify the periodic signal 
g,(t), we can determine its spectrum; conversely, if we specify the spectrum, 
we can determine the corresponding signal. This means that a periodic 
signal g,(¢) can be specified in two equivalent ways: (1) the time-domain 
representation where g,(t) is defined as a function of time, and (2) the 
frequency-domain representation where the signal is defined in terms of 
its spectrum. Although the two descriptions are separate aspects of a given 
phenomenon, they are not independent of each other, but are related, as 
Fourier theory shows. 

In general, the Fourier coefficient c, is a complex number; so we may 
express it in the form 


Cn = |¢,| exp[j arg(c,)] (2.12) 


The term |c,| defines the amplitude of the nth harmonic component of the 
periodic signal g,(t), so that a plot of |c,| versus frequency yields the discrete 
amplitude spectrum of the signal. A plot of arg(c,) versus frequency yields 
the discrete phase spectrum of the signal. We refer to the spectrum as a 
discrete spectrum because both the amplitude and phase of c, have nonzero 
values only for discrete frequencies that are integer (both positive and 
negative) multiples of the fundamental frequency. 

For a real-valued periodic function g,(t), we find from the definition of 
the Fourier coefficient c, given by Eq. 2.11 that 


C,= <6, (2.13) 
where c* is the complex conjugate of c,. We therefore have 
lea = |e (2.14) 
and 
arg(c_,) = —arg(c,) (2:15) 
That is, the amplitude spectrum of a real-valued periodic signal is symmetric 


(an even function of n) and the phase spectrum is asymmetric (an odd 
function of n) about the vertical axis passing through the origin. 


2The term “spectrum” comes from the Latin word for “image.” It was originally 
introduced by Sir Isaac Newton. For a historical account of spectrum analysis, see 
Gardner (1987). 
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EXAMPLE 1 PERIODIC PULSE TRAIN 


seceecece 


Consider a periodic train of rectangular pulses of duration T and period 
Tp, as shown in Fig. 2.1. For convenience, the origin has been chosen to 
coincide with the center of the pulse. This signal may be described ana- 


lytically over one period, —(T/2) < t = (T)/2), as follows ; 
; Í T 
: g(t)= 24 a E (2.16) | 
: 0, for the remainder:of the period : 


eeeeesccoose 


Using Eq. 2.11 to evaluate the complex Fourier coefficient c,, we get 


1 72 Pant) 
Ga A exp| — dt 
E J OE r( T 


= A sin( 2), n= 0227 2, ..2 (2.17) 3 


eoecereceeccsccosors 


Dd 


To simplify notation in the foregoing and subsequent results, we will ; 
use the sinc function defined by 


sin(zå) 


sinc(A) = = 


(2.18) 


where / is the independent variable. The sinc function plays an important 
role in communication theory. As shown in Fig. 2.2, it has its maximum 
value of unity at 1 = 0, and approaches zero as A approaches infinity, : 
oscillating through positive and negative values. It goes through zero at : 


OO 0OO OOOO OOH LOHSOOSSOOSOSEOSEOOEHOSES OO SEOOOSOOSODOOOSSOSOS 


: A = +1, +2,..., and so on. Thus, in terms of the sinc function we 

; may rewrite Eq. 2.17 as follows : 
: TA . (nT : 
: Ca = T, sine(27) (2.19) 
; gp(t) 


Secovccaccocososss 


Figure 2.1 
Periodic train of rectangular pulses of amplitude A, duration T, and period Th. 
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where n has discrete values only. In Fig. 2.3 we have plotted the amplitude 
spectrum |c,| and phase spectrum arg(c,) versus the discrete frequency 
n/T, for a duty cycle T/T) equal to 0.2. We see that 


1. The line spacing in the amplitude spectrum in Fig. 2.3a is determined 
by the period Tọ. 

2. The envelope of the amplitude spectrum is determined by the pulse 
amplitude A and duration T. 

3. Zero-crossings occur in the envelope of the amplitude spectrum at fre- 
quencies that are multiples of 1/T. 

4. The phase spectrum takes on the values 0° and +180°, depending on 
the polarity of sinc(nT/T,); in Fig. 2.35 we have used both 180° and 
— 180° to preserve asymmetry. 


O00 0 lO 000 Oo SEH O OOOO DEOSOEHOSEEOESSSEOSSOS SOOO OS ET SSE AESSH TOSSES SOSH DSBS ES OOSESSSS SO OOOSESSOOFSSOSSOSSSOOSSSSOSHOENOSOOES 


: EXERCISE 1 Plot the amplitude spectra of rectangular pulses of unit am- 
_ plitude and the following two values of duty cycle: 


NED k 
ar T = 0.1 
oe: 


PSOOSSOOCOHOODECOOORR 2.2 FOURIER TRANSFORM 


In the previous sections we used the Fourier series to represent a periodic 
signal. We now wish to develop a similar representation for a signal g(t) 
that is nonperiodic, the representation being in terms of exponential time 
functions. In order to do this, we first construct a periodic function g,(t) 
of period T, in such a way that g(t) defines one cycle of this periodic 
function, as illustrated in Fig. 2.4. In the limit we let the period T, become 
infinitely large, so that we may write 


g(t) = lim g,(t) (2.20) 


Representing the periodic function g,(t) in terms of the complex ex- 
ponential form of the Fourier series, we have 


O ae. exp( 22) (2.21) 


n=— 
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Figure 2.4 
The construction of a periodic function from an arbitrarily defined function of time. 


where 
1 (ti ian 
C= > t) exp| — dt 222 
7 he g(t) o( = (2.22) 
Define 
1 
Ar S T, 
n 
ie = T 
and 
G(f,) = C,rlo 


Thus, making this change of notation in the Fourier series representation 
of g,(t), given by Eqs. 2.21 and 2.22, we get the following relations for 
the interval —(7,/2) < t = (To/2), 


co 


Bolt) =D Gf.) expli2nfat) Af (2.23) 
where 
G(fa) = |" g0) exp(—i2nfat) at (2.24) 
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Suppose we now let the period Tọ approach infinity or, equivalently, its 
reciprocal 4f approach zero. Then we find that, in the limit, the discrete 
frequency f, approaches the continuous frequency variable f, and the 
discrete sum in Eq. 2.23 becomes an integral defining the area under a 
continuous function of frequency f, namely, G(f) exp(j2zft). Also, as 
T, approaches infinity, the function g,(t) approaches g(t). Therefore, in 
the limit, Eqs. 2.23 and 2.24 become, respectively, 


s(t) = | GCA) expli2nfe) af (2.25) 
where 
G(f) = F 0 exp(—j2mft) dt (2.26) 


We have thus achieved our aim of representing an arbitrarily defined signal 
g(t) in terms of exponential time functions over the entire time interval 
from —œ to œ. Note that in Eqs. 2.25 and 2.26 we have used a lowercase 
letter to denote the time function and an uppercase letter to denote the 
corresponding frequency function. 

Equation 2.26 states that, given a time function g(t), we can determine 
a new function G(f) of the frequency variable f. Equation 2.25 states 
that, given this new or transformed function G(f), we can recover the 
original time function g(t). Thus, since from g(t) we can define the function 
G(f) and from G(f) we can reconstruct g(t), the time function is also 
specified by G(f). The function G(f) can be thought of as a transformed 
version of g(t) and is referred to as the Fourier transform ot g(t). The time 
function g(t) is similarly referred to as the inverse Fourier transform of 
G(f). The functions g(t) and G(f) are said to constitute a Fourier trans- 
form pair. 


DIRICHLET’S CONDITIONS 
For a signal g(t) to be Fourier transformable, it is sufficient that g(t) satisfies 
Dirichlet’s conditions: 


1. The function g(t) is single-valued, with a finite number of maxima and 
minima and a finite number of discontinuities in any finite time interval. 


2. The function g(t) is absolutely integrable, that is, 
F le@) dt < o 


The Dirichlet conditions are not strictly necessary but sufficient for the 
Fourier transformability of a signal. These conditions include all energy 
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signals, for which we have? 
[ler a <« 


In the two conditions described herein, the signal g(t) is assumed to be 
complex. 


NOTATIONS 


The formulas for the Fourier transform and the inverse Fourier transform 
presented in Eqs. 2.25 and 2.26 are written in terms of time t and frequency 
f, with t measured in seconds (s) and f measured in hertz (Hz). The 
frequency f is related to the angular frequency œw as w = 2zxf, which is 
measured in radians per second (rad/s). We may simplify the expressions 
for the exponents in the integrands of Eqs. 2.25 and 2.26 by using œ instead 
of f. However, the use of f is preferred over w for two reasons. First, we 
have the mathematical symmetry of Eqs. 2.25 and 2.26 with respect to each 
other. Second, the frequency contents of communication signals (i.e., 
speech and video signals) are usually expressed in hertz. 

A convenient shorthand notation for the transform relations of Eqs. 
2.26 and 2.25 is 


G(f) = Fle()] (2.27a) 
g(t) = F''{G(f)] (2.27b) 


Another convenient shorthand notation for the Fourier transform pair, 
represented by g(t) and G(f), is 


BOGS) (2.28) 


The shorthand notations described herein are used in the text where ap- 
propriate. 


SPECTRUM 


By using Fourier transformation, an energy signal g(t) is represented by 
the Fourier transform G (f), which is a function of the frequency variable 


3If the function g(t) is such that the value of J*..|g(t)|? dt is defined and finite, then 
the Fourier transform G(f) of the function g(t) exists and 


lim l Ip Igit) - E G( f) expl j2nft) df)? at| =0 


This result is known as Plancherel’s theorem. 
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f. A plot of the Fourier transform G(f) versus the frequency f is called 
the spectrum of the signal g(t). The spectrum is continuous in the sense 
that it is defined for all frequencies. In general, the Fourier transform G (f) 
is a complex function of the frequency f. We may therefore express it in 
the form 


G(f) = |G(f)| exp[ja(f)] (2.29) 


where |G(f)| is called the amplitude spectrum of g(t), and 6(f) is called 
the phase spectrum of g(t). 
For the special case of a real-valued fives g(t), we have 


Ch) = GF) 
Therefore, it follows that if g(t) is a real-valued function of time t, then 
IG(—Ff)| = |G(f)| (2.30) 
and 
Af) = sae) (2.31) 


Accordingly, we may make the following statements on the spectrum of a 
real-valued signal: 


1. The amplitude spectrum of the signal is an even function of the fre- 
quency; that is, the amplitude spectrum is symmetric about the vertical 
axis. 

2. The phase spectrum of the signal is an odd function of the frequency; 
that is, the phase spectrum is antisymmetric about the vertical axis. 


These two statements are often summed up by saying that the spectrum 
of a real-valued signal exhibits conjugate symmetry. 


EXAMPLE 2 RECTANGULAR PULSE 


Consider a rectangular pulse of duration T and amplitude A, as shown in 
Fig. 2.5. To define this pulse mathematically in a convenient form, we use 
the following notation 


rect(t) = F -2 ne (2.32) 
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Figure 2.5 
Rectangular pulse. 


which stands for a rectangular function of unit amplitude and unit duration 
centered at £ = 0. Then, in terms of this function, we may express the 
rectangular pulse of Fig. 2.5 simply as follows: 


t 
t) = A rect|— 
g(t) rec ( n 
The Fourier transform of this rectangular pulse is given by 


G(f) = [" 4 exp(—j2nft) dt 


p sin(zfT) 
ae] 


= AT sinc( fT) 


We thus have the Fourier transform pair 


A rea() — AT sinc( fT) (2.33) 


The amplitude spectrum |G(f)| of the rectangular pulse g(t) is shown 
plotted in Fig. 2.6a. From this spectrum, we may make the following 
observations: 


1. The amplitude spectrum has a main lobe of total width 2/7, centered 
on the origin. 


90000 0000000002850 00S000005020009005 08508008 000000000 0000058900500 00908000998 SOOO SSSOSOSDODSODSOSOOSL9OOS 9S SSSOTOSS DSSS SOOO OOOO SOLIS OO OOS OS OOSSIUS 9OSS OOOO SLO SD OS OS OSH OOS SOOSS OSS OS OO OS OSES 


26 FOURIER ANALYSIS 


; IGP i 
; AT ; 
; Jo) Gem f 0 1 2 Bi f ; 
: TT T T T T T : 
(a) : 
: ol), 

: degrees 


Figure 2.6 
Spectrum of rectangular pulse. (a) Amplitude spectrum. (b) Phase spectrum. 
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: 2. The side lobes, on either side of the main lobe, decrease in amplitude 
i with increasing |f|. Indeed, the amplitudes of the side lobes are bounded 
: by the curve 1/|f|. 

i 3. The zero crossings of the spectrum occur at f = +1/T, +2/T,... 
: The phase spectrum 6(f) of the rectangular pulse g(t) is shown plotted 
: in Fig. 2.6b. Depending on the sign of the sinc function sinc( fT), the phase 
: spectrum takes on the values 0° and +180° in an asymmetric fashion. 
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: EXAMPLE 3 EXPONENTIAL PULSE 


: A truncated form of decaying exponential pulse is shown in Fig. 2.7a. We 
: may define this pulse mathematically in a convenient form by using the 
unit step function: 


~ 


n = M) 
u(t) = t=0 (2.34) 
t<0 


Oe m 


~~ 
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Figure 2.7 
(a) Decaying exponential pulse. (b) Rising exponential pulse. 


We may then express the exponential pulse of Fig. 2.7a as 
g(t) = exp(—t)u(t) (2.35) 


The Fourier transform of this pulse is 


GCH) = | exp(—2) exp(-j2afi) de 
= Í "ple + j2mf)] dt 


1 
= E (2.36) 


Thus, combining Eqs. 2.35 and 2.36, we obtain the Fourier transform pair: 


1 


Eo (2.37) 


exp(—t)u(t) = 


Figure 2.8 shows the spectrum of the decaying exponential pulse. 
A truncated rising exponential pulse is shown in Fig. 2.7b, which is 
defined by 


g(t) = exp(t)u(-t) (2.38) 


Note that u(—t) is equal to unity for t < 0, one-half at £ = 0, and zero 
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IG(p| 


Figure 2.8 
Spectrum of decaying exponential pulse. (a) Amplitude spectrum. (b) Phase 
spectrum. 


for t > 0. The Fourier transform of this pulse is given by 


CE i exp(t) exp(—j2nft) dt 
Í ” explt(1 — j2nf)] dt 


a 
erate 


We thus have the Fourier transform pair: 


1 


exp(t)u(—t) = I=- 


Figure 2.9 shows the spectrum of the rising exponential pulse. 


(2.39) 


(2.40) 
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(b) 


Figure 2.9 
Spectrum of rising exponential pulse. (a) Amplitude spectrum. (b) Phase spectrum. 


Comparing the spectra of Figs. 2.8 and 2.9, we may make the following 
two observations: 


1. The decaying and rising exponentials of Fig. 2.7 have the same ampli- 
tude spectrum. 

2. The phase spectrum of the rising exponential is the negative of that of 
the decaying exponential. 
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ececsee . 2.3 PROPERTIES OF THE FOURIER TRANSFORM 


It is useful to have a feeling for the relationship between a function g(t) 
and its Fourier transform G(f), and for the effect that various operations 
on the function g(t) have on the transform G(f). This may be achieved 
by examining certain properties of the Fourier transform. This section 
describes 10 of these properties, which will be proved, one by one. These 
properties are summarized in Table 1 of Appendix D. 
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PROPERTY 1° LINEARITY (SUPERPOSITION) 
Let g,(t) = G,(f) and g,(t) = G,(f). Then for all constants a and b, we have 


ag,(t) + bg,(t) == aG,(f) + bG,(F) (2.41) 


The proof of this property follows simply from the linearity of the in- 
tegrals defining G(f) and g(t). 
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EXAMPLE 4 DOUBLE EXPONENTIAL PULSE 
Consider a double exponential pulse defined by (see Fig. 2.10) 


exp)  ¢ = 0 
1 


ll 
II 
S 


g(t) 


exp(t), t<0 ; 
= exp(— lel) (2.42) | 


This pulse may be viewed as the sum of a truncated decaying exponential 
pulse and a truncated rising exponential pulse. Therefore, using the lin- 
earity property and the Fourier-transform pairs of Eqs. 2.37 and 2.40, we 
find that the Fourier transform of the double exponential pulse of Fig. 2.10 
is as follows 
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1 1 i 

CO) =... | aa : 

) Leen, eae : 

a ; 

Pae : 

We thus have the Fourier transform pair : 


a (a 


exp(- |t) == (2.43) } 


Figure 2.10 
Double exponential pulse. 
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PROPERTY 2 TIME SCALING 
Let g(t) = G(f). Then, 


g(at) —= J af) (2.44) 


where a is a time-scaling factor that may be positive or negative. 


To prove this property, we note that 
Flg(at)] = f” g(at) exp(—j2nfe) dt 


Set z = at. There are two cases that can arise, depending on whether the 
scaling factor a is positive or negative. If a > 0, we get 


- z O exp| -2x (£) r| dt 


F[g(at)] 


lI 
ale 
Q 
E N 
a I% 
Le 


On the other hand, if a < 0, the limits of integration are interchanged so 
that we have the multiplying factor —(1/a) or, equivalently, 1/|a|. This 
completes the proof of Eq. 2.44. 

Note that the function g(at) represents g(t) compressed in time by a 
factor a, whereas the function G(f/a) represents G(f) expanded in fre- 
quency by the same factor a. Thus the scaling property states that the 
compression of a function g(t) in the time domain is equivalent to the 
expansion of its Fourier transform G(f) in the frequency domain by the 
same factor, and vice versa. 


e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
° 
e 
e 
e 
e 
. 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
° 
e 
e 
b 
p4 
a 
e 
e 
è 
è 
e 
e 
a 
(i 
e 
pJ 
8 
a 
e 
e 
e 
e 
e 
e 
e 
° 
® 
e 
e 
e 
e 
e 
e 
e 
. 
e 
e 
e 
è 
e 
e 
e 
e 
s 
b 
e 
e 
e 
e 
e 
e 
e 
° 
e 
e 
. 
s 
e 
e 
è 
e 
° 
e 
e 
e 
e 
e 
e 
e 
e 
a 
e 
e 
e 
e 
e 
® 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
e 
. 


EXAMPLE 5 RECTANGULAR PULSE (CONTINUED) 


seoooeoooo 


Example 2 evaluated the Fourier transform of a rectangular pulse; 
the result of the evaluation is given by the Fourier transform pair of 
Eq. 2.33. For convenience of presentation, let the rectangular pulse 
be normalized to have unit amplitude and unit duration. Then, putting 
A = land T = 1 in Eq. 2.33, we have 


SOSSSCSoS COSTS SOSOSOOSOSSSOCOEE 


rect(t) == sinc(f) 
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Hence, applying the time-scaling property to this Fourier transform pair, 
we get 


rect(a) == e: sne(£) 


lal 


Figure 2.11 shows the rectangular pulse and its amplitude spectrum for 
three different values of the time-scaling factor a, namely a = 1/2, 1, 2. 
With a = 1 regarded as the frame of reference, we may view the use of 
a = 1/2 as expansion in time, and a = 2 as compression in time. These 


g(t) IG(f)| 
2.0 
1.0 
zj 0 1 i f 


-1 0 i 


Parameter a = 1 


-3 -2 -1 0 1 2 3 


j= 


Parameter a = 1 


g(t) 
1.0 IG(f)| 
0.5 
f 


_f 0 2 —2 0 2 
4 4 
Parameter a = 2 


Figure 2.11 
The inverse relation between time- and frequency-domain descriptions of 
rectangular pulse g(t) = rect(at). 


g(t) IG(f)| 
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: observations are confirmed by the three time-domain descriptions depicted : 

: on the left side of Fig. 2.11. The corresponding effects of these time-scale : 

? changes on the amplitude spectrum of the rectangular pulse are shown on 
the right side of Fig. 2.11. The two sets of plots depicted in this figure 
clearly show that the relationship between the time-domain and frequency- 
domain descriptions of a signal is an inverse one. That is, a narrow pulse 
(in time) has a wide spectrum (in frequency), and vice versa. 


e z 
SS OOOSSG SOSH SSSHOSSOSSSEESHSSSOLHSHSOSSSOESOOSOOSLOSSSOSSSSSOSSOSSHHSHSSSE STH OSOHO SHS OSSOSHS SS SOSS SSL OHSSS SOHO SSODOOSO LOSSES 


EXERCISE 2 E gampi 3 3 showed that the Hean a aial pulse and 
` rising exponential pulse of Fig. 2.7 have the same amplitude spectra but 
opposite phase spectra. Use the time- cling property of ihe Trone tans- 
torm; to explain this behavior. a 


PROPERTY 3 DUALITY 
If g(t) = G(f), then 


G(t) = g(-f) (2.45) 


This property follows from the relation defining the inverse Fourier 
transform by writing it in the form 


s(—) = | GO exp(—j2nfe) df 


and then interchanging t and f. Note that G(t) is obtained from G(f) by 
using t in place of f, and g(— f) is obtained from g(t) by using — f in place 
of t. 
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EXAMPLE 6 SINC PULSE H 
Consider a signal g(t) in the form of a sinc function, as shown by : 
; g(t) = A sinc(2W?) (2.46) 


To evaluate the Fourier transform of this function, we apply the duality 
and time-scaling properties to the Fourier transform pair of Eq. 2.33. Then, 
recognizing that the rectangular function is an even function, we obtain 
the following result: 


: A sinc(2 Wt) == sy rea( 55) (2.47) 
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g(t) 
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(a) (b) ; 


Figure 2.12 ; 
(a) Sinc pulse g(t). (b) Fourier transform G(f). 


which is illustrated in Fig. 2.12. We thus see that the Fourier transform of } 
a sinc pulse is zero for |f| > W. Note also that the sinc pulse itself is only ; 
asymptotically limited in time. : 


EXERCISE3 Show that the total area under the curve of the sinc function 
equals one; that is, 


f sinc(e) de = 1 


EXERCISE 4 Consider a one-sided frequency function G(f), defined by 


exp(-f), f>0 
eo ee 
f<0 


Gif) = 


ONE 


Applying the duality property to the Fourier transform pair of Eq. 2.40, 
write the ii inverse Fourier transform of G (f). 


PROPERTY 4 TIME SHIFTING 


If g(t) = G(f), then for a constant time shift toe 


g(t — t) == G(f) exp(—j2zft,). (2.48) 
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To prove this property, we take the Fourier transform of g(t — tọ) and 
then set t = t — h to obtain 


Fle( ~ &)] = exp(—j2nfts) [7 g(+) exp(—j2xft) dr 


exp(—j2afto)G(f) 


The time-shifting property states that if a function g(t) is shifted in the 
positive direction by an amount h, the effect is equivalent to multiplying 
its Fourier transform G(f) by the factor exp(—j2zft)). This means that 
the amplitude of G(f) is unaffected by the time shift but its phase is changed 
by the amount —2zfh. 


EXAMPLE 7 RECTANGULAR PULSE (CONTINUED) 


Consider the rectangular pulse g,(t) of Fig. 2.13a, which starts at time 
t = 0 and terminates at t = T. This pulse is defined by 


nal 2) (2.49) 


g(t =A reai( T 


This pulse is obtained by shifting the rectangular pulse of Fig. 2.5 to the 
right by T/2 seconds. Therefore, applying the time-shifting property to the 
Fourier transform pair of Eq. 2.33, we find that the Fourier transform 
G,(f) of the rectangular pulse g,(t) defined in Eq. 2.49 is given by 


G,(f) = AT sinc(fT) exp(—jzfT) (2.50) 


galt) galt) 


(a) (b) 


Figure 2.13 
Time-shifted versions of a rectangular pulse. 
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Consider next the rectangular pulse g,(t) of Fig. 2.13b, which starts at 
time t = —T and terminates at t = 0. This second pulse is defined by 


ae IU 
2S 
12) asp 


g(t) = A reat( 


The pulse g,(t) is obtained by shifting the rectangular pulse of Fig. 2.5 to 
the left by 7/2 seconds. Therefore, applying the time-shifting property to 
the Fourier transform pair of Eq. 2.33, we find that the Fourier transform 
G,(f) of the rectangular pulse g,(t) defined in Eq. 2.51 is given by 


G,(f) = AT sinc(fT) exp(jzfT) (2.52) 


PROPERTY 5 FREQUENCY SHIFTING 
If g(t) = G(f), then for a constant frequency shift f. 


exp( j2zf,t) g(t) == G(f — f). (2.53) 


This property follows from the fact that 


Flexp(i2nf.t)e(] = |” 80) expl—j2at(f = fo) a 


G(f — f.) 


That is, multiplication of a function g(t) by the factor exp(j2zf,t) is equiv- 
alent to shifting its Fourier transform G(f) in the positive direction by the 
amount f.. Note the duality between the time-shifting and frequency-shift- 
ing operations. 
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EXAMPLE 8 RADIO FREQUENCY PULSE 


Consider the radio frequency (RF) pulse signal g(t) shown in Fig. 2.14a, 
which consists of a sinusoidal wave of amplitude A and frequency f.. The 
pulse occupies the interval from £ = —T/2 to t = T/2. This signal is 
referred to as an RF pulse when the frequency f, falls in the radio-frequency 
band. Such a pulse is commonly used in radar for the detection of targets 
of interest (e.g., aircraft) and for the estimation of useful target parameters 
(e.g., range). 

The signal g(t) of Fig. 2.14a may be expressed mathematically as follows: 


SA ra) cos(2zf,t) (2.54) 
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We M 


(b) 


Figure 2.14 
(a) RF pulse. (b) Amplitude spectrum. 


To find the Fourier transform of this signal, we note that 
cos(2nf.t) = s[exp(j2nf.t) + exp(—j2zf.t)] 


Therefore, applying the frequency-shifting property to the Fourier trans- 
form pair of Eq. 2.33, we get the desired result 


GH) = fsincf TEF - f9) + sincl TF + FO (2-55) 
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C0000 8000S OOOO OOO OO OOSOESOOE OOOH EOS ESSSE OOOO OOOED OOS OLOOSHSOHOHS OOOH OSSESOOOSSSCSESOSOSSCCOSOCSEOES 


38 FOURIER ANALYSIS 


When the number of cycles within the pulse is large, that is, f.T > 1, we 
may use the approximate result 


Ssincl TF -f f>0 


(2.56) 
Ssinel Tf + fb F <0 


GO): = 


The amplitude spectrum of the RF pulse is shown in Fig. 2.14b. This 
diagram, in relation to Fig. 2.6a, clearly illustrates the frequency-shifting 
property of the Fourier transform. 
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_. EXERCISES Consider an exponentially damped sinusoidal wave defined 
by. . . 


g(t) = aes sin(27f.t), ; 3 r (2.57) 


Using the expansion 
sinQnf.t) = 5-[exp(j2nf.t) ~ exp(—j2nf.0)] 


and applying the frequency-shifting property to the Fourier transform pair 
of Eq. 2.37, write the Fourier transform of g(t). Eoo o 


PROPERTY 6 DIFFERENTIATION IN THE TIME DOMAIN 


Let g(t) = G(f), and assume that the first derivative of g(t) is Fourier trans- 
formable. Then 


d ; 
Be g(t) == j2nfG(f) (2.58) 


That is, differentiation of a time function g(t) has the effect of multiplying its 
Fourier transform G(f) by the factor j2nf. 


This result is obtained simply by taking the first derivative of both sides 
of the relation defining the inverse Fourier transform of G(f), namely, 
Eq. 2.25, and then interchanging the operations of integration and differ- 
entiation; we are justified to make this interchange because integration 
and differentiation are both linear operations. 

Multiplication of the Fourier transform G(f) by the factor j2zf on the 


PROPERTIES OF THE FOURIER TRANSFORM 39 


right side of Eq. 2.58 implies that differentiation of g(t) with respect to 
time enhances the high frequency components of the signal g(t). 
We may generalize Eq. 2.58 as follows: 


L aO = (nG) (2.59) 
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EXAMPLE 9 GAUSSIAN PULSE 


In this example we wish to use the differentiation property of the Fourier 
transform to derive the pulse signal g(t) whose Fourier transform G(f) 
has the same form. 

Let g(t) denote the pulse as a function of time, and G(f) its Fourier 
transform. We note that by differentiating the formula for the Fourier 
transform G(f) with respect to f, we have 


—j2xtg(t) — 5 G(f) (2.60) 


which expresses the effect of differentiation in the frequency domain. Equa- 
tion 2.60 is the dual of Eq. 2.58 that describes the time-differentiation 
property. Dividing both sides of Eq. 2.60 by j, we may also write 


—2xtg(t) = - G(f) (2.61) 


<~. 
= 


Suppose that the pulse-signal g(t) satisfies the first-order differential equa- 
tion 


< g(t) = — 2ntg(t) (2.62) 


The imposition of this condition on the pulse signal g(t) is equivalent to 
equating the left-hand members of Eqs. 2.58 and 2.61. Correspondingly, 
we may equate the right-hand members of Eqs. 2.58 and 2.61, and thus 
write 


ld 
== G(f) = j2af G(f (2.63) 
j df = (f) 

Since j? = —1, we may rewrite Eq. 2.63 as 


d 
ap OO) = -2f GUS) (2.64) 


eeeccsee 


eeccevecceceres 


0000000000000 SS 00 SSSSSSSSSCOSSOOSOSSSEOSOOSEOOOOSODTES® 


40 FOURIER ANALYSIS 


git) 
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Figure 2.15 
Gaussian pulse. 


We may now state that if a pulse signal g(t) satisfies the first-order differ- 
ential equation (2.62), then its Fourier transform G(f) must satisfy the 
first-order differential equation (2.64). However, these two differential 
equations have exactly the same mathematical form. Hence, the pulse 
signal and its transform are the same function. In other words, provided 
that the pulse signal g(t) satisfies the differential equation (2.62), then 
G(f) = g(f). Solving Eq. 2.62 for g(t), we obtain 


g(t) = exp(—z?’) (2.65) 


This result is shown plotted in Fig. 2.15. 

The pulse defined by Eq. 2.65 is called a Gaussian pulse, the name being 
derived from the similarity of the function to the Gaussian probability 
density function. We conclude therefore that the Gaussian pulse is its own 
Fourier transform as shown by 


exp(- zt) == exp( -n f?) (2.66) 


EXERCISE 6 Show that 


[ exp(—202) dt = 1 (2.67) 


Hint: Consider the formula for the Fourier transform of ‘exp(— zt’) eval- 
uated at f = 0. . eg ee 
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PROPERTY 7 INTEGRATION IN THE TIME DOMAIN 
Let g(t) = G(f). Then, provided G(0) = 0, we have 


t 1 
F alt) dt —= 5 ait) (2.68) 


That is, integration of a time function g(t) has the effect of dividing its Fourier 
transform G(f) by the factor j2xf, assuming that G(0) is zero. 


To prove this property, we write the Fourier transform of the integrated 
signal as follows 


e| ie Ea) ar| z a exp(—janft) ies g(x) drdt (2.69) 


On the right side of this relation, we have a definite integral with respect 
to the variable t. Clearly, we may view the corresponding integrand as the 
product of two time functions: the exponential exp(—j2zft) and the in- 
tegrated signal f g(t) dt. Hence, using the formula for integration by 
parts and assuming that 


G(0) = ii d 0 


and then simplifying the result, we get the relation of Eq. 2.68. The con- 
dition G(0) = 0 ensures that g(t) integrates out to zero as t approaches 
infinity. The more general case, for which G(0) # 0, is treated later in 
Section 2.5. 

Division of the Fourier transform G(f) by.the factor j2zf on the right 
side of Eq. 2.68 implies that integration of g(t) with respect to time sup- 
presses the high-frequency components of g(t). As expected, this effect is 
the opposite of that produced by differentiation of g(t). 
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EXAMPLE 10 TRIANGULAR PULSE 


Consider the doublet pulse g,(t) shown in Fig. 2.16a. By integrating this 

pulse with respect to time, we obtain the triangular pulse g,(t) shown in } 
Fig. 2.166. The duration of this triangular pulse at the half-amplitude points 
is the same as the duration of the rectangular pulse of Fig. 2.5. We note : 
that the doublet pulse g,(t) consists of two rectangular pulses: one of 
: amplitude A, defined for the interval — T < t < 0, and the other of am- : 
plitude — A, defined for the interval 0 < t < T. Therefore, using the results } 


. 
. 
e 
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AT 


(b) 


Figure 2.16 
(a) Doublet pulse g,(t). (b) Triangular pulse g,(t) obtained by integrating g,(t). 


of Example 7, we find that the Fourier transform G,( f) of the doublet 


pulse g,(t) of Fig. 2.16a is given by 


G,(f) = AT sinc(fT) [exp (jnfT) — exp(—jxfT)] 
2jAT sinc(fT) sin(xfT) (2.70) 


We further note that G,(0) is zero. Hence, using Eqs. 2.68 and 2.70, we 
find that the Fourier transform G,(f) of the triangular pulse g(t) of Fig. 
2.16b is given by 


1 
Gf) = nf G,(f) 


= AT na sinc(fT) 


= AT’ sinc?(fT) (2.71) 


eecce 
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Figure 2.17 
Spectrum of triangular pulse. 


acces 


The Fourier transform G,(f) is a positive real function of f, which means 
that the amplitude spectrum of g,(t) is the same as G,(f), and its phase 
spectrum is zero for all f. The Fourier transform G,(f) is plotted in Fig. 
: 2.17. Note that the spectrum of the triangular pulse is more tightly centered 
: around the origin than the spectrum of the rectangular pulse. Also, the 
spectrum of the triangular pulse decreases as 1/f*, whereas the spectrum 
of the rectangular pulse is discontinuous and decreases as 1/|f]. 


e 
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EXERCISE 7 — 


_a. Show that the Fourier transform of a triangular pulse of unit amplitude 
and unit duration (measured at the Ma pide points) i is capal to 


sinc?(f). 
b. Using the result in part a, show that 
i" " sinf) df = 


l _ Hint: For part b, consider the formula for the i inverse Boyes transform 
- of sine*(f) evaluated att = 0. 


PROPERTY 8 CONJUGATE FUNCTIONS 


If g(t) = G(f), then for a complex-valued time function g(t) we have 
on —— G-7) (2.72) 


where the asterisk denotes the complex conjugate operation. 


Seeovecesooese eeccse 
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To prove this property, we know from the inverse Fourier transform 
that 


g(t) = |” GO) exp(i2afe) af 
Taking the complex conjugates of both sides: 
s"() = | G*(F) exp(—j2nft) af 


Next, replacing f with — f: 
s(t) = -|7 GP) expli2nft) af 
f O*P) exp(i2nge) af 


That is, g*(t) is the inverse Fourier transform of G*(— f), which is the 
desired result. 


COO OCHO CAO CSEEETESOOESOOLESOOEE OOOOH SEO SOD OOSS OOO OTSHOOO OOOO OOOO OSOOSOSOOSHOSSHEOOSHTTASHASOOSSO DESOTO SOS USSEOOESOSESEOOCE 


EXAMPLE 11 REAL AND IMAGINARY PARTS OF A TIME FUNCTION 


Expressing a complex-valued function g(t) in terms of its real and imaginary 
parts, we may write 


COSCO HOSOHOOEESOORTOe 


g(t) = Re[g(t)] + j Im[g(¢)] (2.73) 


where Re denotes the “real part of” and Im denotes the “imaginary part 
of.” The complex conjugate of g(t) is 


Seovecscccesoseseeeee 


g*(t) = Re[g(t)] — j Im[g(¢)] (2.74) 
i Adding Eqs. 2.73 and 2.74: : 
7 Re[g(t)] = ARO + g*(t)] (2.75) 


and subtracting them: 


Prrviriiiiiii rir rrr rrr 


eccccscoonosce 


Im[g(t)] = lel - g*(1)] (2.76) 
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Therefore, applying Property 8, we obtain the following two Fourier trans- 
form pairs: 


Relg] = 5 1G(f) + G*(-A)] (2.77) 
mO] = 5 16(f) - P] (2.78) 


From Eq. 2.78, it is apparent that in the case of a real-valued time 
function g(t), we have G(f) = G*(—f); that is, G(f) exhibits conjugate 
symmetry. This result is a restatement of Eqs. 2.30 and 2.31. 


b 
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EXERCISE 8 Show that for a real-valued signal a(t), Eq, $ 72 may re 


rewritten in the equivalent form: 


PROPERTY 9 MULTIPLICATION IN THE TIME DOMAIN 
Let g,(t) = G,(f) and g,(t) = G,(f). Then 


g(t) got) == T CUG — a) da (2.79) 


To prove this property, we first denote the Fourier transform of the 
product g,(t)g.(t) by Gu(f), so that we may write 


g(t) g(t) = Gaf) 


where 


Gif) = | 81(D8AA) exp(—j2nfe) di 
For g,(t), we next substitute the inverse Fourier transform 
g(t) = | GAF) exp i2nf's) df’ 
in the integral defining G,,(f) to obtain 


Gulf) = f -F aOGAF) expl-j2a(f - f) df’ dt 


— %0 -%0 


SOoeCereceeevessves 
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Define A = f — f’. Then, interchanging the order of integration, we obtain 
Gulf) = [7 da GF ~ 2) f7 ax(0) exp(— janis) dt 
The inner integral is recognized simply as G,(A), so we may write 
Gulf) = | GAGAF - A) di 


which is the desired result. This integral is known as the convolution integral 
expressed in the frequency domain, and the function G,,(f) is referred to 
as the convolution of G,(f) and G,(f). We conclude that the multiplication 
of two signals in the time domain is transformed into the convolution of 
their individual Fourier transforms in the frequency domain. This property 
is known as the multiplication theorem. 

In a discussion of convolution, the following shorthand notation is fre- 
quently used: 


Gulf) = Gif) Gf) 


where the star a denotes convolution. Note that convolution is com- 
mutative, that is, 


G,,(f) = Gx(f) 


or 


Gf) 4 GAF) = Gf) I Gif) 


BOP OOOOH SODA SOOO E ROTO HOODOO OSLO OE SOOO HOSO OOO DED OOOO HU DODO OSES EHOSOES ODO TTT TTT OOEDOOOUESTDSSOHOOOOOEOROOOTOTOSEEONDS 


EXAMPLE 12 TRUNCATED SINC PULSE 


Consider the truncation of the sinc pulse sinc(2W2), so that the resulting 
signal g(t) is zero outside the interval — (7/2) < t < (T/2), as shown in 
Fig. 2.182. This signal may be expressed as the product of a sinc pulse and 
a rectangular pulse, as shown by 


g(t) = sinc(2 Wt) rea) (2.80) 


Figure 2.18 
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(e) 
j 1.0 


function re- 
presenting 
the Fourier 
transform of 
the sinc pulse 
sinc (2Wt) of 
infinite 
duration 


wW LA 
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(b) 
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The Gibbs phenomenon. (a) A truncated sinc function g(t). (b) Fourier transform 


G(f). 


From Eqs. 2.33 and 2.47, we have 


F| rea() | = T sinc(f T) 
F[sinc(2Wt)] = =; rect G5 L) 


Therefore, using Eq. 2.79, we find that the Fourier transform of the trun- 
cated sinc pulse g(t) is given by 


T f> À 
= aw s rea) sinc[(f = À) T] dh 


a „ IG — A)T] da 


Mi el A)T] 
m a(f — AL a 


(2.81) 


SPOvoooescosecvsesese 
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Figure 2.19 
The sine integral. 


The integral of the function sinx/x from zero up to some upper limit is 
called the sine integral, which is defined as follows 


u sinx 


Si(u) = f — i (2.82) 


The sine integral Si(u) cannot be integrated in closed form in terms of 
elementary functions, but it can be integrated as a power series.‘ It is 
plotted in Fig. 2.19. We see that: (1) the sine integral Si(u) is odd symmetric 
about u = 0; (2) it has its maxima and minima at multiples of 2; and (3) 
it approaches the limiting value 2/2 for large values of u. 

Substituting x = x(f — A)T in Eq. 2.81, we find that the Fourier 
transform G(f) of the truncated sinc pulse may be expressed conveniently 
in terms of the sine integral as follows: 


G(f) = y BBiaWT - nfT) + Si(nWT + xfT)] (2.83) 


This relation is plotted in Fig. 2.18b for the case when T = 8/W. We see 
that G(f) approximates the Fourier transform of a sinc pulse sinc(2 Wt) 
of infinite duration in an oscillatory fashion, with a maximum deviation of 
about 9%. Furthermore, for a given value of W, as the pulse duration T 


‘See Goldman (1948, pp. 76-79). 


PROPERTIES OF THE FOURIER TRANSFORM 49 


is increased, the ripples in the vicinities of the discontinuities of the rect- 
angular function show a proportionately increased rate of oscillation versus 
the frequency, f, whereas their amplitudes relative to the magnitude of 
the discontinuity remain the same. This effect is an example of Gibbs 
phenomenon in Fourier transforms. 


"EXERCISE 9 Using Eq. 2.79, show that 


f een at = f Ear 


~ How is the left side of this relation affected by replacing G,(—f) with 


Seccececcossccoccs 


eccccces 


LETTI 


G( f) in the integral on the right side of the relation? 


PROPERTY 10 CONVOLUTION IN THE TIME DOMAIN 
Let g,(t) = G,(f) and g,(t) = G,(f). Then 


ie giltigat — 2) de == Gf IGAF) (2.84) 


This result follows directly by combining Property 3 (duality) and Prop- 
erty 9 (time-domain multiplication). We may thus state that the convolution 
of two signals in the time domain is transformed into the multiplication of 
their individual Fourier transforms in the frequency domain. This property 
is known as the convolution theorem. Its use permits us to exchange a 
convolution operation for a transform multiplication, an operation that is 
ordinarily easier to manipulate. 

Using the shorthand notation for convolution, we may rewrite Eq. 2.84 
in the form 


g(t) 4p g(t) = G(f)Gf) (2.85) 


where the star 4» denotes convolution. 


eoecccecsacsoesesenes COCCCOOSOSHOOHAER OOS TH SHOR ETHOS OOS OHO OO SESS SOO STOO OSES S OO SD OST DUO SSO ST OOOH OOOH OSOO OOOOH DODOOHOD 


EXAMPLE 13 DERIVATIVE OF A CONVOLUTION INTEGRAL 


Let g,,(t) denote the result of convolving two signals g,(t) and g,(t). Then 
the derivative of g,,(t) is equal to the convolution of g,(t) with the derivative 
of g,(t), or vice versa. That is, if 


8n(t) = g(t) ia 82(t) 


eecccecescecccososeses 
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then i 


= gull) = E s| € 82(t) 


To prove this result, we use the differentiation property (i.e., Eq. 2.58) 
in conjunction with the convolution property (i.e., Eq. 2.85), obtaining 


$ let Fe 20] = 2eflG(NGLN) 


Associating the factor j2xf with G,(f), we may write 


E so | tr at) = [2af GPG) 


which yields the desired result: 


ARO a LO E s0 | I 82(2) (2.86) 


Equation 2.86 shows that the derivative of the convolution of two time 
functions is equal to the convolution of one function with the derivative 
of the other. 


_ EXERCISE 10 Using Eq. 2.84, show that 
gi(t)g(—2) dt = e CPAP af 


How is the right side of this eigen affected by replacing go(—t) with 
gi(t) in the integral on the left side of the relation? How does this result | 
-~ compare with that of Exercise 9? 


OEO Eo 2.4 INTERPLAY BETWEEN TIME-DOMAIN AND 
FREQUENCY-DOMAIN DESCRIPTIONS 


The properties of the Fourier transform and the various examples used to 
illustrate them clearly show that the time-domain and frequency-domain 
descriptions of a signal are inversely related. In particular, we may make 
the following statements: 


1. If the time-domain description of a signal is changed, the frequency- 
domain description of the signal is changed in an inverse manner, and 
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vice versa. This inverse relationship prevents arbitrary specifications of 
a signal in both domains. In other words, we may specify an arbitrary 
function of time or an arbitrary spectrum, but we cannot specify both of 
them together. 

2. If a signal is strictly limited in frequency, the time-domain description 
of the signal will trail on indefinitely, even though its amplitude may 
assume a progressively smaller value. We say a signal is strictly limited 
in frequency or Strictly band-limited if its Fourier transform is exactly 
zero outside a finite band of frequencies. The sinc pulse is an example 
of a strictly band-limited signal, as illustrated in Fig. 2.12. This figure 
also shows that the sinc pulse is only asymptotically limited in time, 
which confirms the opening statement we made for a strictly band- 
limited signal. In an inverse manner, if a signal is strictly limited in time 
(i.e., the signal is exactly zero outside a finite time interval), then the 
spectrum of the signal is infinite in extent, even though the amplitude 
spectrum may assume a progressively smaller value. This behavior is 
exemplified by both the rectangular pulse (described in Figs. 2.5 and 
2.6) and the triangular pulse (described in Figs. 2.165 and 2.17). Ac- 
cordingly, we may state that a signal cannot be strictly, limited in both 
time and frequency. 


BANDWIDTH 


The bandwidth of a signal provides a measure of the extent of significant 
spectral content of the signal for positive frequencies. When the signal is 
strictly band-limited, the bandwidth is well defined. For example, the sinc 
pulse described in Fig. 2.12 has a bandwidth equal to W. When, however, 
the signal is not strictly band-limited, which is generally the case, we en- 
counter difficulty in defining the bandwidth of the signal. The difficulty 
arises because the meaning of “significant” attached to the spectral content 
of the signal is mathematically imprecise. Consequently, there is no uni- 
versally accepted definition of bandwidth. 

Nevertheless, there are some commonly used definitions for bandwidth. 
In this section, we consider two such definitions;> the formulation of each 
definition depends on whether the signal is low-pass or band-pass. A signal 
is said to be low-pass if its significant spectral content is centered around 
the origin. A signal is said to be band-pass if its significant spectral content 
is centered around +f,, where f, is a nonzero frequency. 

When the spectrum of a signal is symmetric with a main lobe bounded 
by well-defined nulls (i.e., frequencies at which the spectrum is zero), we 
may use the main lobe as the basis for defining the bandwidth of the signal. 
Specifically, if the signal is low-pass, the bandwidth is defined as one half 


5Another definition for the bandwidth of a signal is presented in Section 4.8. 
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the total width of the main spectral lobe, since only one half of this lobe 
lies inside the positive frequency region. For example, a rectangular pulse 
of duration T seconds has a main spectral lobe of total width 2/T hertz 
centered at the origin, as depicted in Fig. 2.6a. Accordingly, we may define 
the bandwidth of this rectangular pulse as 1/T hertz. If, on the other hand, 
the signal is band pass with main spectral lobes centered around + f., where 
f, is large, the bandwidth is defined as the width of the main lobe for 
positive frequencies. This definition of bandwidth is called the null-to-null 
bandwidth. For example, an RF pulse of duration T seconds and frequency 
f, has main spectral lobes of width 2/T hertz centered around +f., as 
depicted in Fig. 2.14b. Hence, we may define the null-to-null bandwidth 
of this RF pulse as 2/T hertz. 

Another popular definition of bandwidth is the 3-dB bandwidth.® Spe- 
cifically, if the signal is low-pass, the 3-dB bandwidth is defined as the 
separation between zero frequency, where the amplitude spectrum attains 
its peak value, and the positive frequency at which the amplitude spectrum 
drops to 1/ V2 2 of its peak value. For example, the decaying exponential 
and rising exponential pulses defined in Fig. 2.7 have a 3-dB bandwidth 
of 1/27 hertz. If, on the other hand, the signal is band pass, centered at 
+f. the 3-dB bandwidth is defined as the separation (along the positive 
frequency axis) between the two frequencies at which the amplitude spec- 
trum of the signal drops to 1/V2 of the peak value at f.. The 3-dB band- 
width has the advantage in that it can be read directly from a plot of the 
amplitude spectrum. However, it has the disadvantage in that it may be 
misleading if the amplitude spectrum has slowly decreasing tails. 


EXERCISE 11 Using the idea of a main oean lobe, vani is the band- 3 
width ofa triangular pulse defined in Figs. 2.16b and 217? 


EXERCISE 12 What is the 3-dB bandwidth of the ee exponential 
pulse exp(— at) that i is zero ae negative ea: 


TIME-BANDWIDTH PRODUCT 


For any family of pulse signals that differ by a time-scaling factor, the 
product of the signal’s duration and its bandwidth is always a constant, as 
shown by 


(duration) - (bandwidth) = constant 


For a discussion of the decibel (dB), see Appendix A. 
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The product is called the time—bandwidth product or bandwidth—duration 
product. The constancy of the time-bandwidth product is another mani- 
festation of the inverse relationship that exists between the time-domain 
and frequency-domain descriptions of a signal. In particular, if the duration 
of a pulse signal is decreased by reducing the time scale by a factor a, the 
frequency scale of the signal’s spectrum, and therefore the bandwidth of 
the signal, is increased by the same factor a, by virtue of Property 2, and 
the time—bandwidth product of the signal is thereby maintained constant. 
For example, a rectangular pulse of duration T seconds has a bandwidth 
(defined on the basis of the positive-frequency part of the main lobe) equal 
to 1/T hertz, making the time—bandwidth product of the pulse equal unity. 
Whatever definition we use for the bandwidth of a signal, the time—band- 
width product remains constant over certain classes of pulse signals. The 
choice of a particular definition for bandwidth simply changes the value of 
the constant. 


2.5 DIRAC DELTA FUNCTION 


Strictly speaking, the theory of the Fourier transform, as described in 
Sections 2.2 and 2.3, is applicable only to time functions that satisfy the 
Dirichlet conditions. Such functions include energy signals. However, it 
would be highly desirable to extend this theory in two ways: 


1. To combine the Fourier series and Fourier transform into a unified 
theory, so that the Fourier series may be treated as a special case of 
the Fourier transform. 

2. To include power signals in the list of signals to which we may apply 
the Fourier transform. 


It turns out that both these objectives can be met through the “proper 
use” of the Dirac delta function or unit impulse. 

The Dirac delta function belongs to a special class of functions known 
as generalized distributions that are defined by the use of assignment rules 
given in Eqs. 2.87 and 2.88. In particular, the Dirac delta function,’ denoted 
by ô(t), is defined as having zero amplitude everywhere except at t = 0, 
where it is infinitely large in such a way that it contains unit area under its 
curve, as shown by the pair of rules: 


6(t) = 0, t#0 (2.87) 


7For a detailed treatment of the delta function, see Bracewell (1978) or Lighthill 
(1959). The notation 6(t), which was first introduced into quantum mechanics by 
Dirac, is now in general use; see Dirac (1947). 
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and 
Í aoa i (2.88) 


It is important to realize that no function in the ordinary sense can 
satisfy the two rules of Eqs. 2.87 and 2.88. However, we can imagine a 
sequence of functions that have progressively taller and thinner peaks at 
t = 0, with the area under the curve remaining equal to unity, whereas 
the value of the function tends to zero at every point, except at t = 0 
where it tends to infinity. That is, we may view the delta function as the 
limiting form of a unit-area pulse as the pulse duration approaches zero. It 
is immaterial what sort of pulse shape is used. For example, we may use 
a rectangular pulse of unit area, and thus write 


5. a rea($) (2.89) 
10 T T 


The rectangular pulse is plotted in Fig. 2.20a for t = 5, 1, 0.2. For another 
example, we may use a Gaussian pulse of unit area and thus write 


nt 


ô(t) = os L E exp( - ze) (2.90) 


The Gaussian pulse is plotted in Fig. 2.20b for t = 5, 1, 0.2. From Fig. 
2.20, we clearly see that both pulses take on an impulse-like appearance 
as the parameter t becomes progressively smaller. Some other examples 
are considered in Problem 18. 


EXERCISE 13 Plot the spectra Tot the rectangular and Gaussian 1 pulses 
for the different values of parameter T oe in Fig. 220. 


PROPERTIES OF THE DELTA FUNCTION 


The delta function ô(t) has several useful properties that are consequences 
of the two rules defining it, namely, Eqs. 2.87 and 2.88. These properties 
are discussed here: 


1. The delta function is an even function of time; that is, 


6(t) = 5(-2) (2.91) 


DIRAC DELTA FUNCTION 


Figure 2.20 
(a) Rectangular pulse g(t) = 1/7 rect(t/) for varying +. (b) Gaussian pulse 
g(t) = 1/7 exp(—at?/7’) for varying 7. 
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2. The integral of the product of ô(t) and any time function g(t) that is 
continuous at £ = 0 is equal to g(0); thus 


T g(t) 6(t) dt = g(0) (2.92) 


We refer to this statement as the sifting property of the delta function, 
since the operation on g(t) indicated on the left side of Eq. 2.92 sifts out 
a single value of g(t), namely, g(0). Equation 2.92 may also be used as 
the defining rule for a delta function. 


3. The sifting property of the delta function may be generalized by writing 
f 80 8 - t dt = a) (2.93) 


Since the delta function d(t) is an even function of t, we may rewrite Eq. 
2.93 in a way emphasizing resemblance to the convolution integral, as 
follows: 


F 8@ ôt- d dr = ge) (2.94) 


or 


g(t) I 2A) = g(t) (2.95) 


That is, the convolution of any function with the delta function leaves that 
function unchanged. We refer to this statement as the replication property 
of the delta function. 


4. The Fourier transform of the delta function is given by 
F[d(t)] = Í ” SO exp(— j2mft) dt 
Using the sifting property of the delta function and noting that the expo- 
nential function exp(—j2zft) is equal to unity at t = 0, we obtain 
F[d(t)] = 1 
We thus have the Fourier transform pair: 
oi 1 (2.96) 


This relation states that the spectrum of the delta function d(t) extends 


uniformly over the entire frequency interval from — to œ, as shown in 
Fig. 2.21. 


APPLICATIONS OF THE DELTA FUNCTION 


de Signali By applying the duality property to the Fourier transform pair 
of Eq. 2.96, and noting that the delta function is an even function, we 
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(a) (b) 


Figure 2.21 
(a) Dirac delta function (b) Spectrum. 


obtain 
EEN) (2.97) 


Equation 2.97 states that a dc signal is transformed in the frequency domain 
into a delta function ô(f) occurring at zero frequency, as shown in Fig. 
2.22. Of course, this result is intuitively satisfying. From Eq. 2.97 we also 
deduce the useful relation 


Í A O dt = 3) (2.98) 
where the integral on the left side is simply the Fourier transform of a 
function equal to one for all time ¢. 


Complex Exponential Function Next, by applying the frequency-shifting 
property to Eq. 2.97, we obtain the Fourier transform pair 


exp(j2zf.t) = ò(f = je) (2.99) 


(2) 
s Gif) 


0 0 


(a) (b) 


Figure 2.22 
(a) dc signal. (b) Spectrum. 
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for a complex exponential function of frequency f.. Equation 2.99 states 


. that the complex exponential function exp(j27f,t) is transformed in the 


frequency domain into a delta function ô(f — f.) centered at f = f.. 


Sinusoidal Functions — Consider next the problem of evaluating the Fourier 
transform of the cosine function cos(2zf,t). We first note that 


cos(2zf,t) = = [expt j2nf.t) + exp( —j2znf,t)] 


Therefore, using Eq. 2.99, we find that the cosine function cos(2zf,t) is 
represented by the Fourier transform pair 


cos(2nf.t) = FOG = F) + O +f] 100) 


In other words, the spectrum of the cosine function cos(2zf,t) consists of 
a pair of delta functions centered at f = +f., each of which is weighted 
by the factor 2, as shown in Fig. 2.23. 

Similarly, we may show that the sine function sin(27f,t) is represented 
by the Fourier transform pair 


sinQnf.t) =z E - f) - 6 + fo] 10 


which is illustrated in Fig. 2.24. 


Gif) 
git) 


(a) (b) 


Figure 2.23 
(a) Cosine function. (b) Spectrum. 
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(b) 


—1.0 
fe 
(a) 
Figure 2.24 


(a) Sine function. (b) Spectrum. 


Signum Function The signum function, denoted by sgn(t), is an odd func- 
tion of time defined as follows: 


i. t>0 
sen(t) = : t a (2.102) 
= , t <= 


The waveform of the signum function is shown in Fig. 2.25a. We may view 
the signum function as the limiting form of a time function that consists 
of a positive decaying exponential for positive time and a negative rising 
exponential for negative time. That is, we write 


sgn(t) = lim g(a, t) (2.103) 


jG(f) 


(a) (b) 


Figure 2.25 
(a) Signum function. (b) Spectrum. 
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where 


exp(—at), t= 0 
é t=0 (2.104) 
— exp(at), t0 


It 


g(a, t) 


We may also express g(a, t) in the compact form 


g(a, t) = exp(—at)u(t) — exp(at)u(—t) (2.105) 


where u(t) is the unit step function. The function g(a, t) is plotted in Fig. 
2.26 for the parameter a = 1, 0.5, 0.1. We clearly see that as the value of 
parameter a is progressively reduced, the function g(a, t) becomes closer 
to the signum function in appearance. Applying the time-scaling property 
to the Fourier transform pairs of Eqs. 2.37 and 2.40, we get 


1/a 


expl anut) = n a) 


and 
1/a 
explat)u(-t) == T= (o 
a=10 
a=0.5 
@=0.1 
Figure 2.26 


The function g(a, t) for varying a. 
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Subtracting the second Fourier transform pair from the first one, and then 
using the definition of Eq. 2.105, we get (after combining terms and sim- 


plifying): 


nf 


8 D = TE anf) 


(2.106) 


For the limiting condition when the parameter a approaches zero, the 
function g(a, t) approaches the signum function, in accordance with Eq. 
2.103. Therefore, putting a = 0 in Eq. 2.106, we obtain the desired Fourier 
transform pair for the signum function: 


al 
seni) —— a (2.107) 


The spectrum of the signum function is plotted in Fig. 2.25). 

Another useful Fourier transform pair, involving a signum function de- 
fined in the frequency domain, is obtained by applying Property 3 (duality) 
to Eq. 2.107. We thus obtain the following result: 


Las j sgn(f) (2.108) 


where the signum function sgn(f) is defined by 


1, f= 
song «9, j= 
=, W 


| function Shown i in Fig. I 256. 


Unit Step Function The unit step function, u(t), is defined in Eq. 2.34, 
reproduced here for convenience: 


il C0 
u(t) = 41/2, t= 0 (2.109) 
0, t<0 


The waveform of the unit step function is shown in Fig. 2.27a. From Eqs. 
2.102 and 2.109, or from the corresponding waveforms shown in Figs. 2.25a 
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ste icf 


0 0 
(a) (b) 


Figure 2.27 
(a) Unit step function. (b) Amplitude spectrum. 


and 2.27a, we see that the unit step function and signum function are 
related by 


u(t) = 5 (sents) al (2.110) 


Hence, using the linearity property of the Fourier transform and the Fourier 
transform pairs of Eqs. 2.97, and 2.107, we find that the unit step function 
is represented by the Fourier transform pair 


u(t) == aa = i(f) (2.111) 


This means that the spectrum of the unit step function contains a delta 
function weighted by a factor of 1/2 and occurring at zero frequency, as 
shown in Fig. 2.27b. 


EXERCISE 15 Using the erent property, determine the Four- 
ier transform of the signal 


g(t) = aw cos(2zf.t) 
where u(t) is the unit step function. 


Integration in the Time Domain (Revisited) The relation of Eq. 2.68 de- 
scribes the effect of integration on the Fourier transform of a signal g(t), 
assuming that G (0) is zero. We now consider the more general case, with 
no such assumption made. 

Fet 


y(t) = iP g(t) de (2.112) 
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The integrated signal y(t) can be viewed as the convolution of the original 
signal g(t) and the unit step function u(t), as shown by 


y(t) = F eoue - 1) dr 210) 


where the time-shifted unit step function u(t — t) is defined by 


ie Tmt 
uli — t) = tT=t (2.114) 
0 pt 


“ 


Recognizing that convolution in the time domain is transformed into mul- 
tiplication in the frequency domain, and using the Fourier transform pair 
of Eq. 2.111 for the unit step function u(t), we find that the Fourier 
transform of y(t) is 


at) = ow) | a te TA (2.115) 


2n f 
where G(f) is the Fourier transform of g(t). Since 
GOJO) = GO) d(f) 


we may rewrite Eq. 2.115 in the equivalent form: 


AO T Miti = G0) o(f) (2.116) 


That is, the effect of integrating the signal g(t) is described by the Fourier 
transform pair: 


t 1 1 
I BOC E a aa OOE) (2.117) 


which is the desired result. 

This proof is indirect in that it relies on knowledge of the Fourier trans- 
form of the unit step function. For a direct proof from first principles, refer 
to Problem 20. 


2.6 FOURIER TRANSFORMS OF PERIODIC SIGNALS 


From Section 2.1 we recall that by using the Fourier series, a periodic 
signal g,(t) can be represented as a sum of complex exponentials. Also we 
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know that, in a limiting sense, we can define Fourier transforms of complex 
exponentials. Therefore, it seems reasonable that a periodic signal can be 
represented in terms of a Fourier transform, provided that this transform 
is permitted to include delta functions. 

Consider a periodic signal g,(t) of period Tọ. We can represent g,(t) in 
terms of the complex exponential Fourier series as in Eq. 2.10, which is 
reproduced here for convenience, 


g(t) = > Cs exp( 22") (2.118) 
ee 0 


where c, is the complex Fourier coefficient defined by 


To/2 ‘27 nt 
C, = all 8,(t) exp( -! ant) dt (2.119) 
To /2 T, 


aT 0 


Let g(t) be a pulse-like function, which equals g,(t) over one period 
and is zero elsewhere; that is, 


(t) -n t< Zo 
TO 2 2 (2.120) 
0, elsewhere 


The periodic signal g,(t) may be expressed in terms of the function g(t) 
as an infinite summation, as shown by 


oC) ee a) (2.121) 


m=-% 


Based on this representation, we may view g(t) as a generating function, 
which generates the periodic signal g,(t). 

The function g(t) is Fourier transformable. Accordingly, we may rewrite 
Eq. 2.119 as follows: 


Cn 


Il 
| 
= 
Q 
=~ 
~ 
— 
© 
Ea 
55) 
a 
as 
S] 
= 
eae 
a 


1 n 
= T, o(2) a2?) 


where G (n/To) is the Fourier transform of g(t), evaluated at the frequency 
n/ To. We may thus rewrite Eq. 2.118 as 


g(t) = = > o(4) exp( 222 (2.123) 


n=- 
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or, equivalently, 


5 g(t — mT) = = si o(2) exp( 222 (2.124) 


ma=-2 n=% 


Equation 2.124 is one form of Poisson’s sum formula. 

Finally, using Eq. 2.99, which defines the Fourier transform of a complex 
exponential function, and Eq. 2.124, we deduce the following Fourier 
transform pair for a periodic signal g,(t) with a generating function g(t) 
and period 7): 


SD Bet) =. > o(2) aly - z) (2.125) 


m=-% n=—@ 


This relation simply states that the Fourier transform of a periodic signal 
consists of delta functions occurring at integer multiples of the fundamental 
frequency 1/7), including the origin, and that each delta function is weighted 
by a factor G(n/T,). Indeed, this relation merely provides an alternate 
way of displaying the frequency content of a periodic signal g,(t). 

It is of interest to observe that the function g(t), constituting one period 
of the periodic signal g,(t), has a continuous spectrum defined by G(f). 
On the other hand, the periodic signal g,(t) itself has a discrete spectrum. 
We conclude, therefore, that periodicity in the time domain has the effect 
of making the spectrum of the signal take on a discrete form, where the 
separation between adjacent spectral lines equals the reciprocal of the period. 


POC DSRO COCO DASSEOOSOSSLOOSO ODDS OEEEEDO OOO OD SOSESESED LOSER SOOOSEEOOOSOO OOO STOSODEUSEOESSOSOSODOSESSODODESSEOOSOSSOSSOODOCSLS 


EXAMPLE 14 IDEAL SAMPLING FUNCTION 


An ideal sampling function, or Dirac comb, consists of an infinite sequence į 
of uniformly spaced delta functions, as shown in Fig. 2.28a. We will denote :¿ 
this waveform by : 


ôn (t) = > 6(t — mT) (2.126) 


m= —@ 


We observe that the generating function g(t) for the ideal sampling function 
67,(t) consists simply of the delta function ô(t). Therefore, G(f) = 1, so 
that 


o(2) =1,  foralln (2.127) 
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: g(t) ; 
: T 
TEEST = aie 0 T 27, 3T : 
; (a) ; 
; Gif) ; 
om. 4 258 2 ee aa er re f : 
: To To To To To To To To To To : 
0) 
i Figure 2.28 i 
: (a) Dirac comb. (b) Spectrum. : 
: Thus the use of Eq. 2.125 yields the result : 
; 5 lt- mh) = => ôl f (2.128) : 
; m= —-o n=~-® TF 


? Equation 2.128 states that the Fourier transform of a periodic train of delta } 

: functions in the time domain consists of another periodic train of delta : 
functions in the frequency domain as in Fig. 2.285. In the special case of 
the period To equal to 1 second, a periodic train of delta functions is, like 

? a Gaussian pulse, its own Fourier transform. 

: We also deduce from Poisson’s sum formula, Eq. 2.124, the following : 

: useful relation i 


: > S(t = mT) = = -De xp( 222 : 


m=—% n=— 


: The dual of this relation is 


m=-% n=% 


>, exp(j2nmfTo) = > al = z) (2.129) : 


soccoceccoccccoecosocoocoocensacocooseooceoooeoteooosoovecccssssacasopecsesocsesossocetosecoacotoooooesosoroosoooosocaooooooo 


ecceeseccceasses 2.7 SAMPLING THEOREM 


An operation that is basic to digital signal processing and digital commu- 
_ hications is the sampling process, whereby an analog signal is converted 
into a corresponding sequence of samples that are usually spaced uniformly 
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in time. For such a procedure to have practical utility, it is necessary that 
we choose the sampling rate properly, so that the sequence of samples 
uniquely defines the original analog signal. This is the essence of the sam- 
pling theorem, which is derived in the sequel. 

Consider the arbitrary signal g(t) of finite energy, which is specified for 
all time. A segment of the signal g(t) is shown in Fig. 2.29a. Suppose that 
we sample the signal g(t) instantaneously and at a uniform rate, once every 
T, seconds. Consequently, we obtain an infinite sequence of samples spaced 
T, seconds apart and denoted by {g(nT,)} where n takes on all possible 
integer values. We refer to T, as the sampling period, and to its reciprocal 
f, = 1/T, as the sampling rate. This ideal form of sampling is called in- 
stantaneous sampling. 

Let g,(t) denote the signal obtained by individually weighting the ele- 
ments of a periodic sequence of delta functions spaced T, seconds apart 


git) 


(a) 


Figure 2.29 
The sampling process. (a) Analog signal. (b) Instantaneously sampled version of the 


signal. 
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by the sequence of numbers {g(nT,)}, as shown by (see Fig. 2.29b) 


elt) = >. g(nZ)6(t - xB) (2.130) 


n= -œ 


We refer to g,(t) as the ideal sampled signal. The ideal sampled signal g;(t) 
has a mathematical form similar to that of the Fourier transform of a 
periodic signal. This is readily established by comparing Eq. 2.130 for g;(t) 
with the Fourier transform of a periodic signal given in Eq. 2.125. This 
correspondence suggests that we may determine the Fourier transform of 
the ideal sampled signal g;(t) by applying the duality property to the Fourier 
transform of Eq. 2.125. By so doing, and using the fact that a delta function 
is an even function, we get the desired result: 


gt) =f. X GE- mf.) (2.131) 


m=-% 


where G(f) is the Fourier transform of the original signal g(t), and f. is 
the sampling rate. Equation 2.131 states that the process of uniformly 
sampling a continuous-time signal of finite energy results in a periodic spec- 
trum with a period equal to the sampling rate. 

Another useful expression for the Fourier transform of the ideal sampled 
signal g(t) may be obtained by taking the Fourier transform of both sides 
of Eq. 2.130 and noting that the Fourier transform of the delta function 
6(t — nT,) is equal to exp(—j2anfT,). Let G3(f) denote the Fourier 
transform of g;(t). We may therefore write 


w 


CA) = 2, g(nT,) exp(—j2xnfT,) (2.132) 


n=% 


This relation is called the discrete-time Fourier transform. It may be viewed 
as a complex Fourier series representation of the periodic frequency func- 
tion G;(f), with the sequence of samples {g(nT,)} defining the coefficients 
of the expansion. 

The relations, as derived here, apply to any continuous-time signal g(t) 
of finite energy and infinite duration. Suppose, however, that the signal is 
strictly band-limited, with no frequency components higher than W hertz. 
That is, the Fourier transform G(f) of the signal g(t) has the property 
that G(f) is zero for |f| = W, as illustrated in Fig. 2.30a; the shape of the 
spectrum shown in this figure is intended for the purpose of illustration 
only. Suppose also that we choose the sampling period T, = 1/2W. Then 
the corresponding spectrum G;(f) of the sampled signal g(t) is as shown 
in Fig. 2.305. Putting T, = 1/2W in Eq. 2.132 yields 


G3(f) = (5) exp( -274) (2.133) 
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Figure 2.30 
(a) Spectrum of a strictly band-limited signal g(t). (b) Spectrum of sampled version 
of g(t) for a sampling period T, = 1/2W. 


From Eq. 2.131, we have 


© 


m=-% 


Hence, under the following two conditions: 


1. G(f) = 0 for |f| = W 
2. f, = 2W 


we find from Eq. 2.134 that 
G(f) = = Gf), -W<f<W (2.135) 
Substituting Eq. 2.133 in Eq. 2.135, we may also write 
64) 5 | ex Aaw -W<f<W (2.136) 
2w =. \aw) P wy 


Therefore, if the sample values g(n/2W) of a signal g(t) are specified for 
all time, then the Fourier transform G(f) of the signal is uniquely deter- 
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mined by using the discrete-time Fourier transform of Eq. 2.136. Because 
g(t) is related to G(f) by the inverse Fourier transform, it follows that 
the signal g(t) is itself uniquely determined by the sample values g(n/2W) 
for -œ < n < œ. In other words, the sequence {g(n/2W)} has all the 
information contained in g(t). 

Consider next the problem of reconstructing the signal g(t) from the 
sequence of sample values {g(n/2W)}. Substituting Eq. 2.136 in the for- 
mula for the inverse Fourier transform defining g(t) in terms of G(f), we 
get 


80) = | GCF) exp(i2afe) af 


= i > sl) exp( —Et) exp(j2zft) df 


Interchanging the order of summation and integration: 


g(t) = 2 (5) & ie exp| j2nf l: = al df (2.137) 


The integral term in Eq. 2.137 may be readily evaluated yielding 


os _n_\ sin(2aWt — nz) 
T (55) (2nWt — nn) 


» (5) sinc(2Wt — n), ~% <<% (2.138) 


n=-% 


Equation 2.138 provides an interpolation formula for reconstructing the 
original signal g(t) from the sequence of sample values {g(n/2W)}, with 
the sinc function sinc(2Wr) playing the role of an interpolation function. 
Each sample is multiplied by a delayed version of the interpolation func- 
tion, and all the resulting waveforms are added to obtain g(t). 

We may now state the sampling theorem® for band-limited signals of 
finite energy in two equivalent parts: 


1. A band-limited signal of finite energy, which has no frequency compo- 
nents higher than W hertz, is completely described by specifying the values 
of the signal at instants of time separated by 1/2W seconds. 


"The sampling theorem was introduced to communication theory by Shannon 
(1949). It is for this reason that the theorem is sometimes referred to in the 
literature as the “Shannon sampling theorem.” However, the interest of 
communication engineers in the sampling theorem may be traced back to Nyquist 
(1928). Indeed, the sampling theorem was known to mathematicians at least since 
1915. For historical notes on the sampling theorem, see the review paper by Jerri 
(1977). 


NUMERICAL COMPUTATION OF THE FOURIER TRANSFORM 71 


2. A band-limited signal of finite energy, which has no frequency compo- 
nents higher than W hertz, may be completely recovered from a knowl- 
edge of its samples taken at the rate of 2W samples per second. 


The sampling rate of 2W samples per second, for a signal bandwidth of W 
hertz, is called the Nyquist rate; its reciprocal 1/2 W (measured in seconds) 
is called the Nyquist interval. The sampling theorem serves as the basis for 
the interchangeability of analog signals and digital sequences, which is so 
valuable in digital signal processing and digital communications. 

The derivation of the sampling theorem, as described herein, is based 
on the assumption that the signal g(t) is strictly band-limited. In practice, 
however, an information-bearing signal is not strictly band-limited. Hence, 
distortion may result from the application of the sampling theorem to such 
a signal. (More will be said on this issue in Chapter 5.) 


EXERCISE 16 Apply the duality property to the Fourier transform pair 


Peeeccceooccssscccse 


of Eq. 2.125 and thereby derive Eq. 2.131 for the ideal sampled signal 
Balt). i | 


2.8 NUMERICAL COMPUTATION OF THE FOURIER TRANSFORM 


This section briefly describes a procedure for the computation of the Fou- 
rier transform, which is particularly well suited for use on a digital com- 
puter. We assume that the given signal g(t) is of finite duration. The 
procedure involves first, the uniform sampling of g(t) to obtain a finite 
sequence of samples denoted by g(0), g(T,), g(2T,), ..., g(NT, — T,), 
where T, is the sampling period and N is the number of samples. For a 
correct representation of the signal, the sampling rate 1/T, must be equal 
to or greater than twice the highest frequency component of the signal. 
For the purpose of our present discussion, it is adequate to assume that 
this requirement has been satisfied. It is possible, of course, that the signal 
initially may be in the form of a sequence of samples. In any event, for 
this sequence of samples, we may define a discrete Fourier transform de- 
noted by {G(kF,)}, which consists of another sequence of N samples sep- 
arated in frequency by F, hertz, as shown by 


N 
GLV = T. S eT exp( = 2 kn), a= 0) ON — 1 
z n=0 
(Zar?) 
Equation 2.139 is precisely the formula that would be obtained by using 


the trapezoidal rule for approximating the integral that defines the Fourier 
transform of the given signal g(t). The difference between the actual Fou- 
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rier transform and the sequence {G(kF,)} obtained from Eq. 2.139 gives 
the integration error evaluated at f = kF,. The parameters T, and F, are 
related by 


LF, =~ (2.140) 


To derive the inverse relationship expressing the sequence {g(nT,)} in 
terms of the discrete spectrum {G(kF,)}, we multiply both sides of Eq. 
2.139 by exp(j2zkm/N) and sum over k, obtaining 


N-1 on N-1 N-1 on 
>, G(kF,) exp( jE km] = T; > > g(nT,) exp| i k(m — m| 
k=0 k=0 n=0 

(2.141) 


Interchanging the order of summation on the right side of Eq. 2.141, and 
using the fact that 


N-1 
20 aN, man 
ae exp| j N a m| 7 te otherwise = 
we get 
ee 2n 
5 G(kF,) exp(j = km) = NT,g(mT,) (2.143) 
k=0 


Next, substituting the index n for m and rearranging the terms in Eq. 2.143, 
we get the desired relation 


N-1 
g(nT,) = F, > GCP) exp 7% kn), n=0,1,...,N-1 
k=0 
(2.144) 


which defines the inverse discrete Fourier transform. Here again, it is of 
interest to note that Eq. 2.144 is precisely the formula that would be 
obtained by using the trapezoidal rule for approximating the integral that 
defines the inverse Fourier transform. 

The discrete Fourier transform, as defined in Eq. 2.139, has properties 
that are analogous to those of the continuous Fourier transform. 

An important feature of the discrete Fourier transform is that the signal 
{g(nT,)} and its spectrum {G(kF,)} are both in discrete form. Furthermore, 
they are both periodic, with the period of either one consisting of a finite 
number of samples N. That is, 


g(nT,) = g(nT, + NT,) (2.145) 
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and 
G(kF,) = G(kF, + NF,) (2.146) 


We thus find that the numerical computation of the discrete Fourier trans- 
form is well suited for a digital computer or special-purpose digital pro- 
cessor. Indeed, it is this feature that makes the discrete Fourier transform 
so eminently useful in practice for spectral analysis and for the simulation 
of filters on digital computers. This is all the more so by virtue of the 
availability of an algorithm known as the fast Fourier transform algorithm 
(FFT), which provides a highly efficient procedure for computing the dis- 
crete Fourier transform of a finite-duration sequence. This algorithm takes 
advantage of the fact that the calculation of the coefficients of the discrete 
Fourier transform may be carried out in an iterative manner, there- 
by resulting in a considerable saving of computation time.” To compute 
the discrete Fourier transform of a sequence of N samples using the 
FFT algorithm, we require, in general, N log,N complex additions and 
(N/2) log)N complex multiplications. On the other hand, by using Eq. 
2.139 to compute the discrete Fourier transform directly, we find that for 
each of the N output samples, we require (N — 1) complex additions and 
N complex multiplications, so that the direct computation of the discrete 
Fourier transform requires a total of N(N — 1) complex additions and N? 
complex multiplications. Accordingly, by using the FFT algorithm, the 
number of arithmetic operations is reduced by a factor of N/log,N, which 
represents a considerable saving in computation effort for large N. For 
example, with N = 1024, we reduce the computation effort by about two 
orders of magnitude. Indeed, it is this kind of improvement that also makes 
it possible to use special-purpose digital processors for the hardware im- 
plementation of the FFT algorithm. 


2.9 RELATIONSHIP BETWEEN THE FOURIER AND 
LAPLACE TRANSFORMS 


The Fourier transform (as we have described it) is fully adequate for han- 
dling the frequency-domain description of signals encountered in the study 
of communication theory. Nevertheless, it can be helpful to briefly examine 
the relation between it and the Laplace transform, which is commonly used 
in transient analysis. 

Consider the special case of a causal signal g(t), defined as a signal that 
is zero for negative time. In other words, the signed g(t) starts at or after 
t = 0. In such a case, the formula for the Fourier transform of g(t) takes 


For a description of the FFT algorithm and its applications, see Roberts and Mullis 
(1987) or Oppenheim and Schafer (1975). 
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the form 


Gore [ O E (2.147) 


This integral bears a close resemblance to the one-sided Laplace transform 
of g(t), as shown by 


G(s) = I ” g(t) exp(—st) dt (2.148) 


which implies that g(t) = 0 for t < 0. The quantity 
s=o+ jo (2.149) 


is a complex variable whose real and imaginary parts are ø and w, respec- 
tively. Comparing Eqs. 2.147 and 2.148, we see that the Fourier transform 
G(f) may be obtained from the Laplace transform G(s) by putting 


S = jw = j2nf 


This is the link that connects the Fourier and Laplace transforms. 

As mentioned previously, the Fourier transform is adequate for most 
purposes in communication theory. As such, we will use it exclusively in 
the rest of the book. 


DOO9OOOCOT0OCOTDOS0000000000t0000000000000t000000000000000000000V000000T000t0000000000000000000000000000000000020000000 D0 0rovopoorcos 


PROBLEMS 


The problems are divided into sections that correspond to the major sec- 
tions in the Chapter. For example, the problems in Section P2.1 pertain 
to Section 2.1. This practice is followed in subsequent chapters. 


P2.1 Fourier Series 


Problem 1 A signal that is sometimes used in communication systems is 
a raised cosine pulse. Figure P2.1 shows a signal g,(t) that is a periodic 


8p it) 


1 + cos (27?) 


t (seconds) 
ee — 2 3 = 
2 2 
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Figure P2.1 


Richard J. tiormsen, ESE Department 
California State Polytechnic Univ, 
2001 West Temple Avenue 


Pomona, CA $1768 PROBLEMS 75 


sequence of these pulses with equal spacing between them. Show that the 
first three terms in the Fourier series expansion of g,(t) are as follows: 


8 
- g(t) = 2+ zn t) + $cos(2zt) + -> 


Problem 2 Evaluate the amplitude spectrum of the periodic pulsed RF 
waveform shown in Fig. P2.2, assuming that f.To > 1. 


Figure P2.2 
Ti 
Problem 3 Prove the following properties of the Fourier series: N € 
(a) If the periodic function g,(t) is even, that is, 
g( =t) = g(t) 
then the Fourier coefficients, the c,, are purely real and even, that is, 


Cin = Cy. 
(b) If g,(t) is odd, that is, 


Fas) z =O 
then the c, are purely imaginary and an odd function of n. 
(c) If g,(t) has half-wave symmetry, that is, 


m gem 


where T, is the period of g,(t), then the Fourier series of such a signal 
consists of only odd-order terms. 


P2.2 Fourier Transform 


Problem 4 Determine the Fourier transform of the signal g(t) consisting 
of three rectangular pulses, as shown in Fig. P2.3. Sketch the amplitude 
spectrum of this signal for the case when T < To. 
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git) 


To 


T 


Hint: Consider a rectangular pulse of amplitude A and duration T, and 
use the linearity and time-shifting properties of the Fourier transform. 


Figure P2.3 


Problem 5 Determine the inverse Fourier transform of the frequency 
function G(f) defined by the amplitude and phase spectra shown in Fig. 
P2.4. 


Problem 6 Show that the spectrum of a real symmetric signal is either 
(a) purely real and even, or (b) purely imaginary and odd. 


P2.3 Properties of the Fourier Transform 


Problem 7 Let 
t 
gi(t) = (2) 


82(t) = x(St) 


arg [G(f)] 


Figure P2.4 
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(a) Determine the Fourier transforms G,(f) and G,(f) in terms of 
the Fourier transform X(f). 

(b) Which of the two time functions, g,(t) and g,(t), corresponds to 
time compression, and which one to time expansion? 

(c) Let 


y(t) = ag,(t) 


Find the value of scaling factor a required to make Y(0) = X(0), where 
Y( f ) is the Fourier transform of y(t). Repeat your calculation for g(t) 
in place of g,(t). 


Problem 8 


(a) Find the Fourier transform of the half-cosine pulse shown in Fig. 
P2.5a. 

(b) Apply the time-shifting property to the result obtained in part (a) 
to evaluate the spectrum of the half-sine pulse shown in Fig. P2.5b. 
(c) What is the spectrum of a half-sine pulse having a duration equal 
to aT? 

(d) What is the spectrum of the negative half-sine pulse shown in Fig. 
P2.5c? 

(e) Find the spectrum of the single sine pulse shown in Fig. P2.5d. 


Problem 9 Any function g(t) can be split unambiguously into an even 
part and an odd part, as shown by 


8(t) + golt) 


g(t) 


Figure P2.5 
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The even part is defined by 


g(t) = 2[g(t) + 8(-4)] 
and the odd part is defined by 
g(t) = 2[g(t) — g(-)] 
(a) Evaluate the even and odd parts of a rectangular pulse defined by 
i IN 
= tl— — — 
g(t) = A rec k :) 

(b) What are the Fourier transforms of these two parts of the pulse? 
Problem 10 Assume the availability of a device that is capable of com- 
puting the Fourier transform of an energy signal g(t) used as input. Explain 
the modifications that will have to be made to the input and output signals 
of such a device so that it may also be used to compute the inverse Fourier 


transform of the quantity G(f), where g(t) = G(f). 


Problem 11 The Fourier transform of a signal g(t) is denoted by G(f). 
Prove the following properties of the Fourier transform: 


(a) The total area under the curve of g(t) is given by 


[soa = c0) 


where G(0) is the zero-frequency value of G(f ). 
(b) The total area under the curve of G( f) is given by 


F oh) af = g0) 
where g(0) is the value of g(t) at time t = 0 
(c) If a real signal g(t) is an even function of time t, the Fourier trans- 
form G(f) is real. If a real signal g(t) is an odd function of time ż, the 
Fourier transform G( f) is imaginary. 
Problem 12 You are given the Fourier transform pair 


“ exp(— 70?) == exp(—zf?) 


for a standard Gaussian pulse. Using the time-scaling property, show that 


il 5 ! Fi 
exp| —— | == 'exp( —22¢f?r? 
oan Pf 22 e. p( AA 
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Problem 13 Prove the following properties of the convolution process: 
(a) The commutative property: 
gi(t) > g(t) = g(t) > glt) 
(b) The associative property: 
gilt) ap [eO Be ax) = [nO A ao] gl 
(c) The distributive property: 
gilt) tp [a2() + 0] = 10 dp ao) + 2 a BO 


P2.4 Interplay Between Time-Domain and 
Frequency-Domain Descriptions 


Problem 14 Consider a triangular pulse of height A and base 27. The 
duration of the pulse is measured at half-amplitude points. The bandwidth 
of the pulse is defined as one-half the main lobe of the pulse’s spectrum. 
Show that the time—bandwidth product of the pulse equals unity. 


Problem 15 Consider the sinc pulse 
g(t) = A sinc(2 Wt) 


The duration of the pulse is defined as the duration of the main lobe of 
the pulse. Hence, show that the time—bandwidth product of the sinc pulse 
equals unity. 


Problem 16 Consider the Gaussian pulse 


1 wt? 
g(t) = Va wr} 


The parameter t provides one possible measure for the duration of the 
pulse. Defining the bandwidth of the pulse in a similar manner, show that 
the time—bandwidth product is 1/4. 

Hint: Evaluate the Fourier transform of g(t). 


P2.5 Dirac Delta Function 


Problem 17 Show that the effect of scaling the argument of the delta 
function by a constant a is described by 


O(at) = 7) 
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Problem 18 The delta function may be considered as the limiting form 
of an ordinary function. Some useful representations are 


15 


NE lel 
i = 27 exp ) 
= lim ——- 

70 (t z= TA) 
T sin(t/t) 


t0 TE t 


For each representation, plot the time function and its Fourier transform 
for different values of parameter t. Hence, demonstrate that each time 
function approaches the delta function in the limit. 


Problem 19 Determine the Fourier transform of the signal 


g(t) = cos?(2z fet) 
Problem 20 Let 


g(t) = G(f) 


and assume that G(0) is nonzero. Starting with the Fourier transform ` 
of a signal, evaluate the Fourier transform of the integrated signal 


Jen gids. 


Hints: 


(a) Use the formula for integration by parts. 
(b) Use the limiting forms 


t0 


__ sin(2 
lim SS = 6(f) 


lim cos(2zf t) a 
r0 T 


P2.6 Fourier Transforms of Periodic Signals 


Problem 21 Consider again the periodic signal g,(t) defined in Problem 
1, which has a period of 2 seconds. The generating function of the signal 
is defined by 


Ox {0 + cos(2zt), -$<t<} 
£ 0, for remainder of the period 
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(a) Determine the Fourier transform of the generating function g(t). 
(b) Hence, using the formula of Eq. 2.125, determine the Fourier trans- 
form of the periodic signal g,(t). Compare your result with that of 
Problem 1. 


P2.7 Sampling Theorem 


Problem 22 Specify the Nyquist rate and the Nyquist interval for each of 
the following energy signals: 


(a) g(t) = sinc(2002) 
(b) g(t) = sinc?(2002) 
(c) g(t) = sinc(200¢) + sinc?(200t) 
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FILTERING AND 
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I. Chapter 2 we used Fourier methods to study spectral properties 

of various kinds of signals and relationships between spectra and time- 
domain characteristics of the signals. We also studied the effects that 
various time-domain operations on a signal have on the spectrum of the 
signal. In this chapter we study filtering characteristics of systems. The 
system may be a linear time-invariant filter or communication channel. 
We also consider the linear and nonlinear forms of signal distortion, 
which result from transmission through linear and nonlinear systems, 
respectively. We begin the study by considering the time response of a 
linear time-invariant system. 
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3.1 TIME RESPONSE 


A system refers to any physical device that produces an output signal in 
response to an input signal. It is customary to refer to the input signal as 
the excitation and to the output signal as the response. A system is said to 
be linear if the principle of superposition holds; that is, the response of a 
linear system to a number of excitations applied simultaneously is equal to 
the sum of the responses of the system when the excitations are applied 
individually. The system is said to be time-invariant if a time shift in the 
excitation applied to the system produces the same time shift in the response 
of the system. In this section, we study the time response of linear time- 
invariant systems, with particular reference to filters and channels. A filter 
refers to a frequency-selective device that is used to limit the spectrum of 
a signal to some band of frequencies. A channel refers to a physical medium 
that connects the transmitter of a communication system to the receiver. 
The operation of limiting the spectrum of a signal to some band of fre- 
quencies (by passing the signal through a filter or channel) is called filtering. 
In the time domain, a linear system is described in terms of its impulse 
response, which is defined as the response of the system (with zero initial 
conditions) to a unit impulse or delta function 6(t) applied to the input of 
the system. If the system is time-invariant, then the shape of the impulse 
response is the same no matter when the unit impulse is applied to the 
system. Thus, assuming that the unit impulse or delta function is applied 
at time t = 0, we may denote the impulse response of a linear time-invariant 
system by h(t). Let this system be subjected to an arbitrary excitation x(t), 
as in Fig. 3.14. To determine the response y(t) of the system, we begin by 
first approximating x(t) by a staircase function composed of narrow rec- 
tangular pulses, each of duration 47, as shown in Fig. 3.1b. Clearly the 
approximation becomes better for smaller At. As At approaches zero, 
each pulse approaches, in the limit, a delta function weighted by a factor 
equal to the height of the pulse times 47. Consider a typical pulse, shown 
shaded in Fig. 3.16, which occurs at t = t. This pulse has an area equal 
to x(t) At. By definition, the response of the system to a unit impulse 
or delta function d(¢), occurring at t = 0, is A(¢). It follows, therefore, that 
the response of the system to a delta function, weighted by the factor 
x(t) At and occurring at t = t, must be x(t)h(t — t) At. To find the total 
response y(t) at some time ¢, we apply the principle of superposition. Thus, 
summing the various infinitesimal responses due to the various input pulses, 
we obtain in the limit, as 4t approaches zero, 


y() = f rone “r (3.1) 


This relation is called the convolution integral. Note that for the response 
y(t) to have the same dimension as the excitation x(t), the impulse response 
h(t) must have a dimension that is the inverse of time. 
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Impulse 
response 


(a) 


approximation 


(b) 


Figure 3.1 
(a) Linear system. (b) Approximation of input x(t). 


In Eq. 3.1, three different time scales are involved: excitation time t, 
response time t, and system-memory time t — t. This relation is the basis 
of time-domain analysis of linear time-invariant systems. It states that the 
present value of the response of a linear time-invariant system is a weighted 
integral over the past history of the input signal, weighted according to the 
impulse response of the system. Thus the impulse response acts as a memory 
function for the system. 

In Eq. 3.1, the excitation x(t) is convolved with the impulse response 
h(t) to produce the response y(t). Since convolution is commutative, it 
follows that we may also write 


pei O e (3.2) 


where h(t) is convolved with x(t). 
Using the shorthand notation for convolution, we may rewrite Eq. 3.1 
simply as 


y(t) = x(t) Hh (3.3) 


where ia denotes convolution. Similarly, we may rewrite Eq. 3.2 as 


y() = h(t) T xÀ (3.4) 
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Equations 3.3 and 3.4 highlight the commutative nature of convolution or 
linear filtering. 
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EXAMPLE 1 GRAPHICAL INTERPRETATION OF CONVOLUTION 


We may develop further insight into convolution by presenting a graphical 
interpretation of the convolution integral, which is defined in mathematical 
: terms in Eq. 3.1 or 3.2. We will do so in this example by considering Eq. 
3.1 first and then 3.2. The example is simple and yet illustrative of the 
various steps involved in evaluating the convolution integral. Specifically, 
we consider a linear time-invariant system with an impulse response that 
is a decaying exponential function and that is driven by a unit step function. 

Parts a and b of Fig. 3.2 depict the impulse response A(t) and excitation 


eRe eee e See Hee HeSeSSDTOSSSSOHSCOSSESOSOOOOE® 


h(t) 
: (a) 
: 0 
: x(T) 
(b) 
: 0 
; h(—r) 
(c) 
a 
0 


Figure 3.2 

The steps involved in computing one form of the convolution integral. (a) Impulse 
response. (b) Excitation. (c) Image of the impulse response. (d) Time-shifted image 
of the impulse response. (e) Evaluation of the response. 
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h(t—7) 


(d) 


x(r) h(t— 7) 


(e) 
Area = y(t) 


T 


Figure 3.2 (continued) 


x(t), respectively. For reasons that will become apparent presently, the 
time variable in both cases is shown as t. In accordance with Eq. 3.1, the 
integral consists of the product x(t)h(t — t). We already have x(t). To 
obtain h(t — t), we proceed in two steps. First, we formulate A( — t), which 
is the mirror image of h(t) with respect to the vertical axis, as shown in 
Fig. 3.2c. Then, we shift h(—7t) to the right by an amount equal to the 
specified time ¢ to obtain h(t — 1); this second step is shown in Fig. 3.2d. 
Next, we multiply x(t) by A(t — t), as in Fig. 3.2e, and thereby obtain 
the desired integrand x(t)h(t — t) for the specified value of time t. Finally, 
we calculate the total area under x(t)h(t — t), which is shown shaded 
in Fig. 3.2e. This area equals the value of the system response y(t) at 
time t. 

For the graphical interpretation of Eq. 3.2 we may proceed in a similar 
way, as illustrated in Fig. 3.3. In this second case, the integrand equals 
h(t)x(t — t). The first multiplying factor h(t) is already available, as in 
Fig. 3.3a. The second multiplying factor x(t — t) is obtained by forming 
the image x(—t) of the specified excitation x(t), and then shifting the 
image x(—t) to the right by an amount equal to the specified time t. The 
functions x(t), x(—t), and x(t — t) are depicted in Figs. 3.3b, c, and d, 
respectively. The resulting product h(t)x(t — t) is shown in Fig. 3.3e. 
Comparing Figs. 3.2e and 3.3e, we see that the products x(t)h(t — t) and 
h(t)x(t — t) are reversed with respect to each other. Naturally, they both 
have the same total area under their individual curves, which confirms the 
commutative property of convolution. 
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h(r) 


(a) 


x(r) 


x(—7) 


x(t— r) 


(b) 
(c) 
(d) 


h(r) x(t- 7) 


— 
2 


Figure 3.3 


gral. (a) 
-Shifted image 


g the second form of the convolution inte 
ge of the excitation. (d) Time 


Impulse response. (b) Excitation. (c) Ima 


The steps involved in computin 


ry 
e 
e 
° 
e 
e 
° 
e 
° 
e 
e 
e 
e 
e 
e 
e 
e 
e 
è 
e 
e 
e 
e 
© 
e 
e 
e 
e 
e 
e 
e 
e 
° 
ry 
° 
e 
e 
e 
e 
e 
e 
e 
è 
e 
e 
° 
e 
e 
° 
è 
e 
e 
e 
e 
a 
e 
e 
e 
e 
e 
° 
e 
e 
s 
° 
. 
e 
e 
e 
° 
e 
è 
e 
e 
e 
e 
e 
e 
e 
. 
. 
e 
e 
e 
° 
e 
e 
e 
e 
. 
. 
e 
e 
e 
. 
. 
e 
e 
. 
e 
e 
a 
è 
e 
e 
. 
° 
° 
. 
. 
e 
. 
e 
e 
è 
° 
e 
e 
e 
e 
e 
e 
e 
° 
e 
° 
e 
e 


sponse y(t). 


e 


of the excitation. (e) Evaluation of the ri 


eee eee one n Olt Cte tote ote eee tases eoeenneeeeeescesasecedecececcessscsssensseseeseucoscsccsatvsssoconaceasccccee 


TIME RESPONSE 89 


: _ EXAMPLE 2 TAPPED-DELAY-LINE FILTER 


SOcececceccoasssessoneeee 


Consider a linear time-invariant filter with impulse response h(t). We as- 
sume that 


1. The impulse response h(t) = 0 for t < 0. 
2. The impulse response of the filter is of finite duration, so that we may 
write h(t) = 0 for t > T;. 


Then we may express the filter output y(t) produced in response to the 
input x(t) as follows: 


Ole | E (3.5) 


Let the input x(t), impulse response h(t), and output y(t) be uniformly 
sampled at the rate 1/4t samples per second, so that we may put 


t=nAt (3.6) 
and : 
t=kAt (3.7) 


where k and n are integers, and 47 is the sampling period. We assume that 
At is small enough for the product h(t)x(t — t) to remain essentially 
constant for k At < t S (k + 1) At for all values of k and t of interest. 
Then we can approximate Eq. 3.5 by the convolution sum: 


N-1 


y(n At) = > h(k At)x(n At — k At) At (3.8) 
k=0 
where N At = T;. Defining 
w, = h(k At) At 


we may rewrite Eq. 3.8 as 


Nea 


y(n At) = >) wx(n At — k At) (3.9) 


Equation 3.9 is realized using the circuit shown in Fig. 3.4, which consists 


of a set of delay elements (each producing a delay of At seconds), a set of ; 


eeccccvcesvccesse 
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wocccesocse 


Figure 3.4 
Tapped-delay-line filter. 


multipliers connected to the delay-line taps, a corresponding set of weights 
applied to the multipliers, and a summer for adding the multiplier outputs. 
This circuit is known as a tapped-delay-line filter or transversal filter. Note 
that in Fig. 3.4 the tap-spacing or basic increment of delay is equal to the 
sampling period of the input sequence {x(n 41)}. 

When a tapped-delay-line filter is implemented using digital hardware, 
it is commonly referred to as a finite-duration impulse response (FIR) digital 
filter. The required delay is provided by means of a shift register, with the 
basic increment of delay, 4t, equal to the clock period. An important 
feature of a digital filter is that it is programmable, thereby offering a high 
degree of flexibility in design.! 
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CAUSALITY AND STABILITY 


A system is said to be causal if it does not respond before the excitation 
is applied. For a linear time-invariant system to be causal, it is clear that 
the impulse response A(t) must vanish for negative time. That is, the nec- 
essary and sufficient condition for causality is 


h(t)=0, t<0 (3.10) 


Clearly, for a system operating in real time to be physically realizable, it 
must be causal. However, there are many applications in which the signal 


‘For a detailed treatment of the theory and design of digital filters, see Roberts and 
Mullis (1987) or Oppenheim and Schaffer (1975), 
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to be processed is available in stored form; in these situations the system 


- can be noncausal and yet physically realizable. 


The system is said to be stable if the output signal is bounded for all 
bounded input signals. Let the input signal x(t) be bounded, as shown by 


Ix()|<M, -»<t<» (3.11) 


where M is a positive real finite number. Using Eqs. 3.2 and 3.11, we may 
write 


DOLS f Olt- olde = M f” [ac de 


It follows therefore that for a linear time-invariant system to be stable, the 
impulse response h(t) must be absolutely integrable. That is, the necessary 
and sufficient condition for stability is 


iN In(t)| dt < œ (3.12) 


rere 1 The impulse response of a linear time-invariant system. is 


h(À) = = exp(at) u(— D 


where u(- £) is the T version of the unit step function u(Z). Is 
this system casual? Is it stable? Give reasons for your answers. 


3.2 FREQUENCY RESPONSE 


Consider a linear time-invariant system of impulse response h(f) driven by 
a complex exponential input of unit amplitude and frequency f, that is, 


x(t) = exp(j2zft) (3.13) 


Using Eq. 3.2, the response of the system is obtained as 


y() = | hO expLi2nf(t = 2] dr 


exp(j2nfi) | i a 2a (3.14) 
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Define 


WG) = ie h(t) exp(—j2nft) de (3.15) 


Then we may rewrite Eq. 3.14 in the form 
y(t) = H(f) exp(j2nft) (3.16) 


The response of a linear time-invariant system to a complex exponential 
function of frequency f is, therefore, the same complex exponential func- 
tion multiplied by a constant coefficient H(f). The quantity H(f) is called 
the transfer function of the system. The transfer function H(f) and impulse 
response A(t) form a Fourier transform pair, as shown by the pair of 
relations: 


HG ia h(t) exp(—j2nfe) dt (3.17) 


and 
hO = | H) exp(i2nfi) af (3.18) 


An alternative definition of the transfer function may be deduced by di- 
viding Eq. 3.16 by 3.13 to obtain 


TO 
ooo 


(3.19) 


x() =exp(j27 ft) 


Consider next an arbitrary signal x(t) applied to the system. The signal 
x(t) may be expressed in terms of its Fourier transform as 


x(t) = F X(f) exp(j2nft) df (3.20) 


or, equivalently, in the limiting form 
x(t) = i > X(f) exp(j2nft) af (3.21) 
>U k=- 
f=kaf 


That is, the input signal x(t) may be viewed as a superposition of complex 
exponentials of incremental amplitude. Because the system is linear, the 
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response to this superposition of complex exponential inputs is 


y() = lim X H(A)X(A) exp(i2nft) 4 
fak4f 


f HOXH exp(i2nfo af (3.22) 


The Fourier transform of the output is therefore 


Y(f) = HIX) (3.23) 


A linear time-invariant system may thus be described simply in the fre- 
quency domain by noting that the Fourier transform of the output is equal 
to the product of the transfer function of the system and the Fourier 
transform of the input. 

The result of Eq. 3.23 may, of course, be deduced directly by recognizing 
that the response y(t) of a linear time-invariant system of impulse response 
h(t) to an arbitrary input x(t) is obtained by convolving x(t) with A(t), or 
vice versa, and by the fact that the convolution of a pair of time functions 
is transformed into the multiplication of their Fourier transforms. The 
foregoing derivation is presented primarily to develop an understanding 
of why the Fourier representation of a time function as a superposition of 
complex exponentials is so useful in analyzing the behavior of linear time- 
invariant systems. 


AMPLITUDE RESPONSE AND PHASE RESPONSE 


The transfer function H(f) is a characteristic property of a linear time- 
invariant system. It is, in general, a complex quantity, so that we may 
express it in the form 


H(f) = |H(f)| expliB(f)] (3.24) 


where |H(f)| is called the amplitude response, and f(f) is called the phase 
response. The phase response is related to the transfer function H(f) by 


BC(F) = arglH(f)] (3.25) 


In the case of a linear system with a real-valued impulse response h(t), the 
transfer function H(f) exhibits conjugate symmetry, which means that 


lH(f)| = |H(-f)| (3.26) 


94 FILTERING AND SIGNAL DISTORTION 


and 


BO) = iG) (3.27) 


That is, the amplitude response |H(f)| is an even function of frequency, 
whereas the phase response (f) is an odd function of frequency. Plots of 
the amplitude response |H(f)| and the phase response f(f) versus fre- 
quency f represent the frequency-domain description of the system. Hence, 
we may also refer to H(f) as the frequency response of the system. 

In some applications it is preferable to work with the logarithm of H(f) 
rather than with H(f) itself. Define 


InH(f) = a(f) + jB(f) (3.28) 


where 


a(f) = In|A(f)| (3.29) 


The function a(f) is called the gain of the system. It is measured in nepers, 
whereas (f) is measured in radians. Equation 3.28 indicates that the gain 
a(f) and phase response $(f) are the real and imaginary parts of the 
logarithm of the transfer function H(f), respectively. The squared ampli- 
tude response |H(f)|’ is identified with power. Accordingly, we may also 
apply the decibel (dB) measure to the gain by writing 


a'(f) = 20 logiolH(f)| (3.30) 
The two gain functions a(f) and a'(f) are related by 


a'(f) = 8.69a(f) (3.31) 


That is, 1 neper is equal to 8.69 dB. 
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EXAMPLE 3 


Consider a linear time-invariant device with a transfer function defined by 


=e 0 
H(f) = 0, f =0 
a f=20 

= -j sgn(f) G2) 


where sgn(f) is the signum function. 
The amplitude response and phase response of the device are shown in 
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|H(f)| Bi), 
degrees 


(a) | (b) 


Figure 3.5 
Characteristics of a Hilbert transformer. (a) Amplitude response. (b) Phase response. 


Fig. 3.5a and b, respectively. That is, the device produces a phase shift of 
— 90° for all positive frequencies and a phase shift of + 90° for all negative 
frequencies. The amplitudes of all frequency components of the input signal 
are unaffected by transmission through the device. Such an ideal device is 
called a Hilbert transformer. 

Figure 3.6 shows a black-box representation of the Hilbert transformer 
with a Fourier transformable signal x(t) acting as input, and the resulting 
output? denoted by £(t). We wish to determine the output £(2), given the 
input x(t). To do so, we first determine the impulse response of the device. 
Specifically, we use the Fourier transform pair of Eq. 2.107 to express the 
impulse response of the Hilbert transformer as 


h(t) = = 3 


Hence, the convolution of this impulse response with a signal x(t) applied 
to the input of the Hilbert transformer yields the resulting output £(t) as 


10 = x0 4 (4) 


= = KU (3.34) 


TOP — ag 


According to this formula, £(f) is the Hilbert transform of x(t). 


2When dealing with Hilbert transformation, it is customary to denote the output by 
placing a circumflex (or “hat”) over the symbol for the input; this explains the 
reason for using X(t) rather than y(t) to denote the output. 
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Input time function Output time function 


x(t) x(t) 


Hilbert 
transformer 


Figure 3.6 
Black-box representation emphasizing that both the input and output of a Hilbert 
transformer are time functions. 
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EXERCISE 2 The javerse Hilbert transform, defining x(t) in terms of (t), 
is described by : : | 


x) = £ F AO) h 6.35) 


y — 00 t S7 
Starting with the transfer function of Eq. 3.32, derive the formula of Eq. 


SYSTEM BANDWIDTH 


To specify the degree of dispersion of the amplitude response or gain of 
a system, we use a parameter called the system bandwidth. A common 
definition of system bandwidth is the 3-dB bandwidth, the exact formulation 
of which depends on the type of system being considered. In the case of 
a low-pass system, the 3-dB bandwidth is defined as the difference between 
zero frequency, at which the amplitude response attains its peak value 
|H(0)|, and the frequency at which the amplitude response drops to a value 
equal to |H(0)|/V2, as illustrated in Fig. 3.7a. In the case of a band- 
pass system, the 3-dB bandwidth is defined as the difference between the 
frequencies at which the amplitude response drops to a value equal to 
1/V/2 times the peak value |H(f.)| at the midband frequency f., as illus- 
trated in Fig. 3.7b. Note that in both cases, the system bandwidth is defined 
for positive frequencies. Note also that an amplitude response value equal 
to 1/V2 times the peak value of the amplitude response is equivalent to 
a drop in the gain of 3-dB below its peak value; hence, the name “3-dB 
bandwidth.” 


secsecessceeeseeee 3.3 LINEAR DISTORTION AND EQUALIZATION 


Two basic forms of signal distortion result from the transmission of a signal 
through a physical system: linear distortion and nonlinear distortion. In the 
context of telecommunications, the system of interest is comprised of all 
the components that constitute the path from the source of information to 
the desired destination. When the system is viewed as being linear and 


LINEAR DISTORTION AND EQUALIZATION 97 


1H(f)! 


(HUF) | 


lH tfo 
V2 


B (b) 


Figure 3.7 
The definition of system bandwidth. (a) Low-pass system. (b) Band-pass system. 


time invariant, linear distortion arises owing to imperfections in the fre- 
quency response of the system. On the other hand, nonlinear distortion 
arises owing to the presence of nonlinearities in the makeup of the system. 
In this section, we discuss the linear distortion problem; nonlinear distor- 
tion is considered in Section 3.7. We begin the discussion by formulating 
the conditions for distortionless transmission of a signal through a linear 
time-invariant system. 


CONDITIONS FOR DISTORTIONLESS TRANSMISSION 


By distortionless transmission we mean that the output signal of a system 
is an exact replica of the input signal, except for a possible change of 
amplitude and a constant time delay. We may therefore say that a signal 
x(t) is transmitted through the system without distortion if the output signal 
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y(t) is defined by 
y = Kx(t — h) (3.36) 


where the constant K accounts for the change in amplitude and the constant 
t accounts for the delay in transmission. 

Let X(f) and Y(f) denote the Fourier transforms of x(t) and y(®, 
respectively. Then, applying the Fourier transform to Eq. 3.36 and using 
the time-shifting property of the Fourier transform, we get 


Y(f) = KX(f) exp(—j27ft) (3.37) 
The transfer function of a distortionless system is therefore 


H(A) = 5G 


= K exp(—j2zft) (3.38) 
Correspondingly, the impulse response of the system is given by 
h(t) = Kô(t — t) (3.39) 
where ô(t — tọ) is a Dirac delta function shifted by t seconds. 
Equation 3.38 indicates that in order to achieve distortionless trans- 


mission through a system, the transfer function of the system must satisfy 
two conditions: 


1. The amplitude response |H(f)| is constant for all frequencies, as shown 
by 


|H(f)| = K (3.40) 


2. The phase f(f) is linear with frequency, passing through zero as shown 
by 


PO) = = 27, (3.41) 


These two conditions are illustrated in parts a and b of Fig. 3.8, re- 
spectively. 


-EXERCISE 3 Using the impulse response of Eq. 3.39 in the convolution 
- integral, show that the input-output relation of a distortionless system is 
as defined in Eq. 3.36. a oe tle eet 
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|A(f)| Bip) 


0 f 


Slope = —27t 


0 


(a) (b) 


Figure 3.8 
Frequency response for distortionless transmission. (a) Amplitude response. 
(b) Phase response. 
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(f) for distortionless transmission may be modified by adding a constant 
ve or negative integer multiple of 180°. How can sudi a 
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AMPLITUDE DISTORTION AND PHASE DISTORTION 


In practice, the conditions for distortionless transmission, as just described, 
can only be satisfied approximately. That is to say, there is always a certain 
amount of linear distortion present in the output signal. In particular, we 
may distinguish two components of signal distortion produced by trans- 
mission through a linear time-invariant system: 


1. When the amplitude response |H(f)| of the system is not constant with 
frequency inside the frequency band of interest, the frequency com- 
ponents of the input signal are transmitted with different amounts of 
gain or attenuation. This effect is called amplitude distortion. The most 
common form of amplitude distortion is excess gain or attenuation at 
one or both ends of the frequency band of interest. 


2. The second form of distortion arises when the phase response f(f) of 
the system is not linear with frequency. Then if the input signal is divided 
into a set of components, each one of which occupies a narrow band 
of frequencies, we find that each of them is subject to a different delay 
in passing through the system, with the result that the output signal has 
a different waveform from the input. This form of distortion is called 
phase or delay distortion. We will have more to say on this issue in 
Section 3.6. 
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You should carefully note the distinction between a constant delay and 
a constant phase shift. These two conditions have different implications. 
Constant delay is a requirement for distortionless transmission, Constant 
phase shift, on the other hand, causes signal distortion. 


EQUALIZATION 


To compensate for linear distortion, we may use a network known as an 
equalizer connected in cascade with the system in question. The equalizer 
is designed in such a way that, inside the frequency band of interest, the 
overall amplitude and phase responses of this cascade connection approx- 
imate the conditions for distortionless transmission to within prescribed 
limits. 

Consider, for example, a communication channel with transfer function 
H.(f). Let an equalizer of transfer function H.,(f) be connected in cascade 
with the channel, as in Fig. 3.9. The overall transfer function of this com- 
bination is equal to H.(f)H.,(f). For overall transmission through the 
cascade connection of Fig. 3.9 to be distortionless, we require that (see 
Eq. 3.38) 


H.(f)He(f) = K exp(—j2zfty) (3.42) 


where K is a scaling factor and h is a constant time delay. Ideally, therefore, 
the transfer function of the equalizer is inversely related to that of the 
channel, as shown by 


K exp(—j2zfto) 


HEC) a H (f) 


(3.43) 


In practice, the equalizer is designed such that its transfer function ap- 
proximates the ideal value of Eq. 3.43 closely enough for the linear dis- 
tortion to be reduced to a satisfactory level. 

A network structure that is well-suited for the design of equalizers is 
the tapped-delay-line filter, depicted in Fig. 3.4. From the time-shifting 
property of the Fourier transform, we know that when a signal is shifted 


Delayed version 
of channel input 


Input Equalizer 


Heq (f) 


Figure 3.9 
Block diagram of equalization. 
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in time by 4q seconds, its Fourier transform is multiplied by the complex 
exponential exp(—j2zf 4t). Accordingly, the transfer function of this tapped- 
delay-line filter, used as an equalizer, is given by 


N-1 


H.,(f) = > w, exp(—j2akf At) (3.44) 


For convenience of analysis, let the number of taps be odd, as shown by 
N=2M+1 (3.45) 
where M is an integer. Also, setting 


Re... E 
= -M..., -1,001,...0 9) 


and 
W, =*c., (3.47) 


we may rewrite Eq. 3.44 as 
M 
H..(f) = | È Cn exp(—-j2amf sneso(—iaemy At) (3.48) 
m=-M ’ 


The expression inside the square brackets on the right side of Eq. 3.48 
represents the discrete-time Fourier transform of the sequence of tap coef- 
ficients C_y,..-,C-1, Co, C1, - - - , Cy, With a tap spacing (sampling in- 
terval) of 4t seconds. This discrete-time Fourier transform may be viewed 
as a truncated version of the complex Fourier series with a frequency 
periodicity of 1/4t hertz; note that in this interpretation, the usual roles 
of time and frequency in the complex Fourier series are interchanged. 

We may now describe a procedure for designing the equalizer. Specif- 
ically, given a channel of transfer function H,(f) to be equalized over the 
interval — B < f < B, we first approximate the reciprocal transfer function 
1/H.(f) by a complex Fourier series with periodicity (1/41) = B. Typically, 
H.{f) is specified numerically in terms of its amplitude and phase com- 
ponents, in which case numerical integration is used to compute the com- 
plex Fourier coefficients. The total number of significant terms, 2M + 1, 
is chosen to be just big enough to produce a satisfactory approximation 
to the prescribed H,(f). The tap coefficients of the equalizer, namely, 
Cop + = 5 C15 Co, Ci; «=. , Cy are then matched to the complex Fourier 
coefficients. 


- (1/41) B, 


@cccesvccsesecceooses 
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EXERCISE 5 Write the formula for evaluating the coefficients of the 
complex Fourier series used to approximate 1/H.(f) with periodicity 


3.4 IDEAL LOW-PASS FILTERS 


As previously mentioned, a filter is a frequency-selective device that is used 
to limit the spectrum of a signal to some specified band of frequencies. Its 
frequency response is characterized by a passband and a stopband, which 
are separated by a guardband. The frequencies inside the passband are 
transmitted with little or no distortion, whereas those in the stopband are 
rejected. The filter may be of the low-pass, high-pass, band-pass, or band- 
stop type, depending on whether it transmits low, high, intermediate, or 
all but intermediate frequencies, respectively. 

In this section we study the time response of the ideal low-pass filter, 
which transmits, without any distortion all frequencies inside the passband 
and completely rejects all frequencies inside the stopband, as illustrated 
in Fig. 3.10. Note that the conditions for distortionless transmission need 
only be satisfied inside the pass band of the filter. The transfer function of 
the ideal low-pass filter so illustrated is defined by 


H(f) = (ee a te ae (3.49) 


where, for convenience, we have set K = 1. The parameter B defines the 
bandwidth of the filter. For a finite tọ, the ideal low-pass filter is noncasual, 


|H(f)| 


Slope = —2rTto 
(b) 


Figure 3.10 
Frequency response of ideal low-pass filter. (a) Amplitude response. 
(b) Phase response. 
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which may be confirmed by examining the impulse response h(t). Specif- 
_ ically, by evaluating the inverse Fourier transform of the transfer function 
of Eq. 3.49, we get 


h(t) = E exp[j2af(t — t)] df (3.50) 


where the limits of integration have been reduced to the frequency band 
inside which H(f) does not vanish. Equation 3.50 is readily integrated, 
yielding 


sin[2zB(t — to)] 
n(t — to) 
2B sinc[2B(t — to)] (3.51) 


h(t) = 


This impulse response has a peak amplitude of 2B centered on time ty, 
as shown in Fig. 3.11. The duration of the main lobe of the impulse response 
is 1/B, and the build-up time from the zero at the beginning of the main 
lobe to the peak value is 1/2B. We see from Fig. 3.11 that, for any finite 
value of t, there is some response from the filter before the time t = 0 at 
which the unit impulse is applied to the input, confirming that the ideal 
low-pass filter is noncausal. However, despite its noncausality, the ideal 
low-pass filter serves as a useful standard against which the response of 
causal filters may be measured. 


. Figure 3.11 
Impulse response of ideal low-pass filter. 
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EXAMPLE 4 PULSE RESPONSE OF IDEAL LOW-PASS FILTER 


Consider a rectangular pulse x(¢) of unit amplitude and duration T, which 
is applied to an ideal low-pass filter of bandwidth B. The problem is to 
determine the response y(t) of the filter. 

The impulse response A(t) of the filter is defined by Eq. 3.51. Its response 
is therefore given by the convolution integral 


y() = [- x@ne =4)dr 


72 sin[2xB(t — t — 7)] 
= ee 352 
i A 27B(t = to ma T) i ( ) 


Define 
A = 2nB(t — t — 1) 


Then, changing the integration variable from t to 4, we may rewrite Eg. 
3.52 as 


; 1 f2zB-0+T/2) sin J 

: t =- = di A 
: yo 7 one A : 
S 1 na sin À dì a lai sin À di 
nz | Jo A 0 A ; 


L {Si[2zB(t — to + T/2)] — Si[2xB(t - t — T/2)}} (3.53) 

n 

where the sine integral is defined by 

Si(u) = i ee i (3.54) 
0 


Figure 3.12 plots the response y (t) for three different values of the filter 
bandwidth B, assuming that t is zero. We see that, in each case, the output 
is symmetric about t = 0. We further observe that the shape of the output 
is markedly dependent on the filter bandwidth B. In particular, we note: 


1. When B is large compared with 1/T, as in Fig. 3.12a, the output has 
approximately the same duration as the input. However, it differs from 
the input in two major respects. First, the output, unlike the input, has 
nonzero rise and fall times that are inversely proportional to the filter 
bandwidth. Second, the output exhibits ringing at both the leading and 
trailing edges. ! 
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Pulse response of ideal low-pass filter for varying filter bandwidth. (a) B = 2/T. 
(b) B = 1/T. (c) B = 1/4T. The dashed rectangles represent the input signal 


Figure 3.12 
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2. When B = 1/T, as in Fig. 3.125, the output is recognizable as a pulse; 
however, the rise and fall times of the output are significant compared 
with the input pulse duration T. 

3. When the filter bandwidth B is small compared with 1/T, the output is 
a grossly distorted version of the input, as in Fig. 3.12c. 


. 
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EXERCISE 6 How large would you have to make the delay t for the ideal 
low-pass filter to be causal? Rr i F 


0000o 3.5 BAND-PASS TRANSMISSION 


A problem often encountered in the study of communication systems is 
that of analyzing the transmission of a signal through a band-pass system. 
Typically, the incoming signal and the system of interest are both narrow- 
band with a common midband frequency. We say that a band-pass signal 
is narrow-band if the bandwidth of the signal is small compared to its 
midband frequency. A similar definition holds for a band-pass system. A 
precise statement about how small the bandwidth must be in order for the 
signal to be considered narrow-band is not necessary for our present dis- 
cussion. Obviously, we may analyze the band-pass transmission problem 
directly by using the convolution integral of Eq. 3.1 or its Fourier-trans- 
formed version given in Eq. 3.23. However, a more efficient approach is 
to replace the problem with an equivalent low-pass transmission model, 
the development of which proceeds in two stages. First, a complex low- 
pass representation is devised for the incoming band-pass signal. Next, a 
similar representation is devised for the band-pass system. In the sequel, 
these two representations are considered in turn. 


COMPLEX LOW-PASS REPRESENTATION OF NARROW-BAND SIGNALS 


Consider a narrow-band signal x(t) with Fourier transform X(f). The am- 
plitude spectrum |X(f)| of the signal is depicted in Fig. 3.13a. The pre- 
envelope of the signal x(t) is defined by 


x(t) = x(t) + jO (3.55) 


where £(¢) is the Hilbert transform of the signal x(t). The pre-envelope 
x(t) is a complex-valued function of time with the original signal x(t) as 
the real part and the Hilbert transform £(t) as the imaginary part. Let 
X,(f) denote the Fourier transform of the pre-envelope x,(t). We may 
thus write, in the frequency domain, , 


X.(f) = X(f) + jX(f) (3.56) 
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2|X(fo)| 


(c) 


Figure 3.13 
(a) Amplitude spectrum of band-pass signal x(t). (b) Amplitude spectrum of pre- 
envelope x(t). (c) Amplitude spectrum of complex envelope x(t). 


where X(f) is the Fourier transform of ¢(t). From Example 3, we deduce 
that X(f) equals the product —j sgn (f) X(f), where sgn(f) is the signum 
function. Accordingly, we may rewrite Eq. 3.56 as 


X.(f) = X(f) + i[-J sen] xX/) 
= X(f) + sen(f)X(f) 
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Moreover, using the definition of the signum function, we get 


2A AA 
X.(f) = 4X(0), f= 
0, f<0 (3.57) 


where X(0) is the zero-frequency value of X(f). Equation 3.57 states that 
the pre-envelope of a Fourier transformable signal has no frequency con- 
tent for negative frequencies, as illustrated in Fig. 3.135. 

The frequency-shifting property of the Fourier transform suggests that 
we may express the pre-envelope x ,(t) in the form 


x(t) = E(t) exp(j2zf.t) (3.58) 


where X(t) is a complex-valued low-pass signal. The amplitude spectrum 
of X(t) is illustrated in Fig. 3.13c. 

Given the narrow-band signal x(t), we may determine the complex en- 
velope X(t) by first using Eq. 3.55 to find the pre-envelope x,(t), and then 
solving Eq. 3.58 for x(t) in terms of x, (t). Alternatively, we may determine 
¥(t) by using a frequency-domain approach based on X(f), the Fourier 
transform of x(t). Specifically, we retain the positive-frequency half of X(f) 
centered on f,, shift it to the left by f., and then scale it by a factor of 
two. The spectrum so obtained is the Fourier transform of the complex 
envelope £(f). The rationale for this second method of determining <(t) 
follows from the spectra depicted in Fig. 3.13. The second method is usually 
the preferred method, because it bypasses the need to know the Hilbert 
transform £(f). 

The complex envelope £(t) provides the basis for the complex low-pass 
representation of the narrow-band signal x(t). Indeed, in accordance with 
Eqs. 3.55 and 3.58, the real part of the product £(¢) exp(j2zf,t) is equal 
to x(t), as shown by 


x(t) = Re[ X(t) exp(j2zf,t)] (3.59) 


where Re[*] denotes the “real part of” the quantity enclosed in the square 
brackets. Using the Euler identity 


exp(j2n f.t) = cos(2zf,t) + j sin(27f,t) 


and the definition for the complex envelope (t), we readily find from Eq. 
3.59 that x(t) may be expressed as? 


x(t) = x(t) cos(2zf,t) — xolt) sin(2zf,t) (3.60) 


‘Equation 3.60 follows directly from the following rule. Let a, b, and c denote three 
complex numbers related to one another as 


c= ab 
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This is the canonical representation for a narrow-band signal in terms of 
_the in-phase component x,(t) and quadrature component x(t) of the com- 
_ plex envelope associated with the signal. Indeed, it is a representation basic 
to all linear modulation schemes; more will be said on this issue in Chap- 
ter 7. 

The complex envelope X(t) is defined in terms of the in-phase component 
x(t) and the quadrature component xo(t) as follows: 


EC) = x(t) + j xÀ) (3.61) 


In other words, x,(t) is the real part of X(t), and xQ(f) is its imaginary part. 


_ EXERCISE 7 Consider a narrow-band signal x(t) with Fourier transform 
= X(f). Show that the value of X,(f), the Fourier transform of the ee 
envelope of x(t), at frequency f=0isX (0). 


EXERCISE 8 Let x(t) = nto cos(2xf,t), where m(t) is an information- 
bearing signal. What are the in-phase and quadrature components of x(t)? 
whet is the collies eoveline: i AOU : 


COMPLEX LOW-PASS REPRESENTATION OF NARROW-BAND SYSTEM 


Consider next a narrow-band system defined by the impulse response h(t) 
or, equivalently, the transfer function H(f). To develop a complex low- 
pass representation for this system, we may perform time-domain opera- 
tions on A(t) or frequency-domain operations on H(f). From the previous 
discussion of narrow-band signals, we expect the second approach to be 
the preferred one, as it is computationally less intensive. Accordingly, from 
analogy with the complex low-pass representation of a narrow-band signal, 
we may develop the desired complex low-pass representation of the narrow- 
band system by retaining the positive-frequency half of the transfer function 
H(f) centered on f,, and shifting it to the left by f.. Let H(f) denote the 
transfer function of the complex low-pass system so defined. Figure 3.14 
illustrates the relationship between H(f) and H(f), shown in parts a and 
b of the figure, respectively. Note, however, that in going from H(f) to 
H(f), we have purposely avoided amplitude scaling (see Exercise 9). Note 
also that for the frequency-domain transformation depicted in Fig. 3.14 to 
hold, the midband frequency f, must be larger than half the bandwidth of 
the narrow-band system. 


Then, the real part of cis given by 

Re[c] = Rela] Refb] — Imla] Im[b] 
where Re[*] denotes the “real part of” and Im[*] denotes the “imaginary part of” the 
respective quantities enclosed in the square brackets. 
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|H(f)| IE (f) 


(a) (b) 


Figure 3.14 
(a) Amplitude response of narrow-band system. (b) Amplitude response of complex 
low-pass system. 


EQUIVALENT LOW-PASS TRANSMISSION MODEL 


We are now equipped with the tools we need to formulate the equivalent 
low-pass transmission model for solving the band-pass transmission prob- 
lem. Specifically, the analysis of a narrow-band system with transfer func- 
tion H(f) driven by a narrow-band signal with Fourier transform X(f), as 
depicted in Fig. 3.15a, is replaced by an equivalent but simpler analysis 
of a complex low-pass system with transfer function H(f) driven by a 
complex low-pass input with Fourier transform X(f), as depicted in Fig. 
3.156. This band-pass to low-pass transformation completely retains the 
essence of the filtering process. 

According to Fig. 3.15a, the Fourier transform of the output of the 
narrow-band system is given by 


Y¥(f) = HO) X(f) 


The narrow-band output y(‘) itself is given by the inverse Fourier transform 


of Y(f). 


According to Fig. 3.155, the Fourier transform of the output of the 
complex low-pass system is given by 


YA) = ex) (3.62) 


Narrow-band 
system, 


H(f) 


Complex low-pass | F (f) 
system, 


H(f) 


Y(f) 


(a) (b) 


Figure 3.15 
Transformation of narrow-band to complex low-pass system. 
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The complex low-pass output y(t) itself is given by the inverse Fourier 
transform of Y(f). Having determined y(t), we may find the desired nar- 
row-band output y(t) simply by using the relation: 


y(t) = Re[ y(t) exp(j27f.t)] (3.63) 


The low-pass transmission model of Fig. 3.15b is said to be the baseband 
equivalent of the narrow-band system in Fig. 3.15a. The equivalence is in 
the sense that the model of Fig. 3.155 completely preserves the information 
content of the incoming narrow-band signal x(t) and also that of the outgoing 
narrow-band signal y(t). In general, the term “‘baseband”’ is used to des- 
ignate the band of frequencies representing a signal of interest as delivered 
by a source of information. In the context of our present situation, the 
term baseband refers to both input and output. 


EXERCISE 9 Evaluate y(0) using the two models of Fig. 3.15. Hence, 
_ justify the need for scaling the spectrum of the complex low-pass input — 
. (0) by a factor of two, as diuiteds in Fig. 3.13c. 
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EXAMPLE 5 RESPONSE OF AN IDEAL BAND-PASS FILTER TO A 
PULSED RF WAVE 

Consider an ideal band-pass filter of midband frequency f., and bandwidth 
B as in Fig. 3.16a, with f. > B/2. Note that the conditions for distortionless 
transmission need only be satisfied for the pass band of the filter. Note 
also that the phase response of the filter is zero at the mid-band frequence 
fe We wish to determine the response of this filter to an RF pulse of 
duration T and frequency f. defined by (see Fig. 3.17a) 


x(t) =A rea(4) cos(2r f.t) 


where f-T > 1. 

Retaining the positive-frequency half of the transfer function H(f), 
defined in Fig. 3.16a, and then shifting it to the origin, we find that the 
transfer function H(f) of the low-pass equivalent filter is given by [see Fig. 
3.16] 


A(f) = fa j2nfto), —B/2 eee (3.64) 


The complex impulse response in this example has only a real component, 
as shown by 


h(t) = B sinc[B(t — t)] (3.65) 
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slope = —2 Tt) 


Af) If) 


slope = —2 T t9 


Figure 3.16 
(a) Amplitude response |H(f)| and phase response f\f) of an ideal band-pass filter. 
(b) Corresponding components of complex transfer function H(f). 


From Example 3 we recall that the complex envelope £(t) of the input RF 
pulse also has only a real component, as shown by (see Fig. 3.17b): 


PORET. rea(4) (3.66) 


The complex envelope f(t) of the filter output is obtained by convolving 
the A(t) of Eq. 3.65 with the X(t) of Eq. 3.66. This convolution is exactly 
the same as the low-pass filtering operation that we studied in Example 3. 
Thus, using Eq. 3.53 we may write 


no a 


(3.67) 


As expected, the complex envelope j(t) of the output has only a real 
component. Accordingly, from Eqs. 3.63 and 3.67, the output is obtained 
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X(t) © 


(a) 
yit) 


tc) 


Figure 3.17 
The response of an ideal band-pass filter to RF pulse input. (a) RF pulse input x(t). 
(b) Complex envelope x(t) of RF pulse. (c) Response y(t). 
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(3.68) : 
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y(t) = 
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which is the desired result. Equation 3.68 is shown sketched in Fig. 3.17c ; 
: for the case when the band-pass filter bandwidth B = 1/T. : 
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3.6 PHASE DELAY AND GROUP DELAY 


Suppose a steady sinusoidal signal at frequency f, is transmitted through 
a dispersive channel that has a total phase-shift of #(f.) radians at that 
frequency. By using two phasors to represent the input signal and the 
received signal, we see that the received signal phasor lags the input signal 
phasor by #(f,) radians. The time taken for the received signal phasor to 
sweep out this phase lag is simply equal to f(f,)/2zf,. seconds. This time 
is called the phase delay of the channel. 

It is important, however, to realize that the phase delay is not necessarily 
the true signal delay. This follows from the fact that a steady sinusoidal 
signal does not carry information. In actual fact, as we will see in subsequent 
chapters, information can be transmitted only by applying some appro- 
priate change to the sinusoidal wave. Suppose then a slowly varying signal 
is multiplied by a sinusoidal wave, so that the resulting modulated wave 
consists of a narrow group of frequencies. When this modulated wave is 
transmitted through the channel, we find that there is a delay between the 
envelope of the input signal and that of the received signal. This delay is 
called the envelope or group delay of the channel and represents the true 
signal delay. 

Assume that the dispersive channel is described by the transfer function 


H(f) = K exp[jA(f)] (3.69) 


where the amplitude K is a constant and the phase f(f) is a nonlinear 
function of frequency. The input signal x(t) consists of a narrow-band sig- 
nal defined by 


x(t) = x,(t) cos(2zf,t) (3.70) 


where x,(t) is a low-pass function with its spectrum limited to the frequency 
interval |f| < W. We assume that f, > W. By expanding the phase f(f) 
in a Taylor series* about the point f = f., and retaining only the first two 
terms, we may approximate f(f) as 


sORE+ Fe) een 


Define 


Tp = 2 (3.72) 


“For a general definition of the Taylor series, see Appendix D, Table 4. 
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and 


_ _1 of) 
oe ao (3.73) 


Then we may rewrite Eq. 3.71 in the form 


BF) z po, a 2n(f Pa De (3.74) 
Correspondingly, the transfer function of the channel takes the form 
H(f) = J$ exp[ SL = j2n(f = igi (3.75) 


Following the procedure described in Section 3.5, we may replace the 
channel described by H(f) by an equivalent low-pass filter with complex 
transfer function 


A(f) = K exp(—j2nf.t, — j2nft,) (3.76) 


Similarly, we may replace the input narrow-band signal x(t) by its low-pass 
complex envelope x(t), which is 


X(t) = x(t) (3577) 
The Fourier transform of X(t) is simply 


X(f) = X(f) (3.78) 


where X,(f) is the Fourier transform of x,(t). Therefore, the Fourier trans- 
form of the complex envelope of the received signal is given by 


Y(f) = AŽ) 
= K exp(—j2zf,t,) exp(—j2aft,) X-(f) (3.79) 


We note that the multiplying factor K exp(—j2zf,t,) is a constant. We 
also note, from the time-shifting property of the Fourier transform, that 
the term exp(—j2zft,)X.(f) represents the Fourier transform of the de- 
layed signal x,(t — t,). Accordingly, the complex envelope of the received 
signal equals ; 


y(t) = Kexp(-j2nfet) x(t — t) (3.80) 


Finally, we find that the received signal is itself given by 


y(t) 


Re[ y(t) exp(j2zf.t)] 
ioc (t — t,)eos(2xy.{t — z,)] (3.81) 


li 
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Equation 3.81 shows that, as a result of transmission through the channel, 
two delay effects occur: 


1. The sinusoidal carrier wave cos(27f,t) is delayed by t, seconds; hence 
Tp represents the phase delay. Sometimes, t, is also referred to as the 
carrier delay. 

2. The envelope x,(t) is delayed by t, seconds; hence, T represents the 
envelope or group delay. Note that t, is related to the slope of the 
phase $(f), measured at f = f., as in Eq. 3.73. 


Note also that when the phase response f(f) is linear with frequency, 
and (0) = 0, the phase delay and group delay assume a common value. 


CISE 10 Explain why a linear time-invariant system with a phase 
se equal to a constant suffers from phase distor ion. 


3.7 NONLINEAR DISTORTION 


Up to this point in our study of signal transmission through a system, we 
have assumed linearity. In practice, however, we find that the system 
connecting a source of information to its destination inevitably exhibits 
some form of nonlinear behavior. This occurs whenever the output is in- 
creased beyond a limit prescribed by the power that the system is capable 
of supplying. In such a situation, we say that the system is overloaded. 
When the system is overloaded, a change in the input signal does not 
produce a corresponding change in the output signal. 

Figure 3.18 shows a typical input-output relation, called the transfer 
characteristic, that may give rise to nonlinear distortion. For the purpose 
of our discussion here, we assume that the system is memoryless in the 
sense that the output y(t) depends only on the input x(t) at time t. We 
may consider the transfer characteristic of Fig. 3.18 to be composed of the 
following parts: 


1. A reasonably linear region centered at the origin, where a change in 
the input produces a proportional change in the output. 


2. Two saturation regions, where the output is not affected by the input. 


3. Two “knees” that join the linear region to the saturation regions. The 
useful amplitude range of operation of the system is defined by points 
P and Q that lie somewhere on the knees of the curve. Their precise 
locations are determined by the extent of nonlinear distortion that is 
considered to be tolerable. We may thus view P and Q as overload 
points. 
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Output, y(t) 


Input, x(t) 


f 
l 
I 
<4— Saturation — kÆ Linear >i t4— Saturation —> 
region region region 


Figure 3.18 
Transfer characteristic. 


To evaluate the nonlinear distortion, the common procedure is to ex- 
press the transfer characteristic mathematically by writing the output y(t) 
as a power series of the input x(t): 


y(t) = a,x(t) + ax?(t) + a3x°(t) ++: (3.82) 


The first term, a,x(t), represents the linear response of the system. The 
second term, a,x°(t), accounts for a lack of symmetry that may exist be- 
tween the positive and negative parts of the transfer characteristic. (This 
term would be zero for the symmetric curve shown in Fig. 3.18.) The third 
term, a;x*(t), provides a first approximation to the flattening of the transfer 
characteristic due to overloading. Higher order terms on the right side of 
Eq. 3.82 are usually neglected when operation of the system is bounded 
by the overload points (P and Q in Fig. 3.18). 

Let X(f) denote the Fourier transform of the input x(t). Then, the 
Fourier transform of the output y(t) is 


Y(f) = a X(f) + a X(f) Ir X(f) 
+ asX(f) $e X(f) Pe X(f) + °° (3.83) 


where > denotes convolution. Thus, X DN X(f) denotes the convo- 
lution of X(f) with itself, and so on. Let x(t) be band-limited in W, such 
that X(f) = 0 for |f| = W. Then, x?(t) is band-limited in 2W, such that 
X(f) N X(f) = 0 for |f| = 2W. Similarly, x?(t) is band-limited in 3W, 
such that XAN XG) X(f) = 0 for |f| = 3W, and so on. We may 
therefore make two observations: 


1. The output of a nonlinear system contains new frequency components 
` for f > W, which are not present in the input. 


2. The presence of nonlinearities (second order, third order, etc.) in the 


LOCOCO SHSOOS OES DESO OO SSEESO ODEO OOOO OOOD STS OLOOSS SO OSD OSH OOS OO EOOEESOOOOTOSOTTTOOSOO STH OSSOSOSESOOOS OHO DOD ESOOETOSOOSOOOOOSE 
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transfer characteristic produces undesirable frequency components for 
[fl = W. 


The first set of components can be suppressed by appropriate filtering. On 
the other hand, the second set of components lying inside the frequency 
band of interest cannot be removed, thereby giving rise to nonlinear dis- 
tortion. 

Two examples to illustrate the analysis of nonlinear distortion follow. 
In both cases, the problem is simple enough to be handled without having 
to resort to the use of Fourier transformation. 


EXAMPLE 6 HARMONIC DISTORTION 


Let the input consist of a single sinusoidal wave: 
x(t) = A cos(2zft) (3.84) 


We assume that only second- and third-order nonlinearities in the transfer 
characteristic of Fig. 3.18 are of concern, so that fourth- and higher-order 
terms in Eq. 3.82 may be ignored. Then, substitution of Eq. 3.84 in 3.82 
yields the output 


y(t) = aA? + (aA + = ay") cos(27 ft) 


+ yA? cos(4zft) + Taa’ cos(6zft) (3.85) 


Since we are concerned primarily with distortion (i.e., changes in the shape 
of the waveform), we may ignore the dc component, 3a,A?. The compo- 
nents of interest in the output waveform are therefore as follows, with 
their respective amplitudes shown: 


Fundamental: aA + = ass 
: 1 
Second harmonic: 5 a, A? 
p : 1 
Third harmonic: 7 a,A? 


Accordingly, we define the second-harmonic distortion, D5, as the ratio of 
the amplitude of the second-harmonic component in the output to that of 
the fundamental: 


5d 
Dd, = Sna (3.86) 
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Similarly, we define the third-harmonic distortion, D3, as the ratio of the 
amplitude of the third-harmonic component in the output to that of the 
fundamental: 


De — (3.87) 


The harmonic distortion factors D, and D, are usually expressed as per- 
centages. 


e 
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EXAMPLE 7 INTERMODULATION DISTORTION 


Let the input x(t) consist of the sum of two sinusoidal waves: 
x(t) = A, cos(2zf,t) + A, cos(2zf,t) (3.88) 


Here again we assume that fourth- and higher-order terms in Eq. 3.82 may 
be ignored. Then, substituting this expression for x(t) in Eq. 3.82, we find 
that the effects produced by the second- and third-order nonlinearities in 
the transfer characteristic are: 


1. The second-order term, a,x7(t), produces a dc and a second-harmonic 
component corresponding to the single-frequency input, as expected. 
In addition, however, it produces new components at f, + f, and 
fı — f, that are the sum and difference frequencies, respectively. Such 
components are referred to as second-order intermodulation products. 


TABLE 3.1 
Type of 
Intermodulation 
Product Frequency Amplitude 
Second-order ja ae ja aA,A, 
fi-h aAA, 
3 
Third-order 2h; =f fa q 241A 
3 2 
2f: ae 4 BAiA 
3 2 
P ne I 4 PAA} 
3 2 
2h Ji g BALA} 
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2. The third-order term, a,x°(t), produces the expected fundamental and 
third-harmonic components. In addition, it gives rise to intermodulation 
products of its own at the frequencies 2f, + f, and 2f, + fı, which are 
referred to as third-order intermodulation products. 


Table 3.1 presents a summary of the frequencies and amplitudes of the : 
various second- and third-order intermodulation products. 


erecocovccesssooes 
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PROBLEMS 


P3.1 Time Response 


Problem 1 The excitation applied to a linear time-invariant system with 
impulse response h(t) consists of two delta functions, as shown by 


x(t) = d(t + t) + A(t — to) 
where t is a constant time shift. Find the response of the system. 


Problem 2 The impulse response of a linear time-invariant system is 
defined by 


h(t) = exp(—at)u(t) 


where u(t) is the unit step function. Determine the response of the system 
produced by an excitation consisting of the unit step function u(t). 


Problem 3 A periodic signal x,(t) of period Ty is applied to a linear time- 
invariant system of impulse response h(t). Use the complex Fourier series 
representation of x,(t) and the convolution integral to evaluate the re- 
sponse of the system. 


Problem 4 The impulse response of a linear time-invariant system is 
defined by the Gaussian function: 


A(t) = exp[—x(t — t)] 
where f is a constant. 


(a) Is this system causal? 
(b) Is it stable? 


Give reasons for your answers. 
P3.2 Frequency Response 


Problem 5 Continuing with the linear time-invariant system described in 
Problem 2, do the following: 


(a) Determine the transfer function of the system. 
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Figure P3.1 


(b) Plot the amplitude response and phase response of the system. 
(c) Find the 3-dB bandwidth of the system. 


Problem 6 Find the transfer function of the linear time-invariant system 
with its impulse response defined in Problem 4. Hence, plot the amplitude 
response and phase response of the system. Indicate the 3-dB bandwidth 
of the system on the plot of the amplitude response. 


Problem 7 Evaluate the transfer function of a linear system represented 
by the block diagram shown in Fig. P3.1. 


Problem 8 


(a) Determine the overall amplitude response of the cascade connection 
shown in Fig. P3.2 consisting of N identical stages, each with a time 
constant RC equal to To. 

(b) Show that as N approaches infinity, the amplitude response of the 
cascade connection approaches the Gaussian function exp(—2f*T77), 
where for each value of N, the time constant to is selected so that 


— 
4r? N 


P3.3 Linear Distortion and Equalization 


Problem 9 


(a) Consider a signal x(t) with Fourier transform X(f) limited to the 
band —B < f < B. This signal is applied to a linear time-invariant 
system with an amplitude response |H(f)| and linear phase, as in Fig. 
P3.3a. Determine the resulting output of the system. 


Figure P3.2 
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(b) 


Figure P3.3 


(b) Suppose that the system has a constant amplitude response but 
nonlinear phase, as in Fig. P3.3b. Determine the resulting output. As- 
sume that the constant b, is small enough to justify using the approxi- 


mation: 
4 ie Seman 
exp| ib sin( 2) = 1+ jb, sin( 22) 


Problem 10 Figure P3.4 shows an idealized model of a radio channel. It 
consists of two paths. One path introduces a propagation delay t). The 


Input Output 


Figure P3.4 
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other path introduces an additional delay t and an attenuation represented 
by the scaling factor a that is less than one. A channel so characterized is 
referred to as a multipath channel. To correct for the multipath distortion, 
a three-tap equalizer is connected in cascade with the channel. Given that 
a? < 1, calculate the three tap coefficients of the tapped-delay-line equal- 
izer. 

Hint: Use the binomial expansion: 


1 


ia ao Lae T — ay 2 A N., 
Eea S EE 


P3.4 Ideal Low-Pass Filters 


Problem 11 The transfer function of an ideal low-pass filter is defined 
by 


H(f) = te exp(—j2nftr), f A 


where fp is a constant. Find the impulse response of the system. 


Problem 12 An ideal low-pass filter has zero time delay and bandwidth 
B. It is driven by a rectangular pulse of unit amplitude and duration 
T equal to 1/B and centered at t = 0. 


(a) Show that the filter output at ¢ = 0 is given by 


y(0) = = Si(n) 


where Si(z) is the value of the sine integral for an argument equal 
to z. 
(b) Show that the filter output at £ = 7/2 is given by 


1 
»(2) a Si(27) 
where Si(2z) is the value of the sine integral for an argument of 27. 


(c) Calculate these two values of the filter output and-check them against 
the corresponding pulse response shown in Fig. 3.10b. l 


Note that Si(z) = 1.85 and Si(27) = 1.42. —* 


Problem 13 Suppose that, for a given signal x(t), the integrated value 
of the signal over an interval T is required, as shown by 


y(t) = f 0 dt 
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(a) Show that y(t) can be obtained by transmitting the input signal x(t) 
through a filter with its transfer function given by 


H(f) = T sinc(fT) exp(—jzfT) 


(b) An adequate approximation to this transfer function is obtained by 
using a low-pass filter with a bandwidth equal to 1/7, passband ampli- 
tude response T, and delay T/2. Assuming this low-pass filter to be 
ideal, determine the filter output at time t = T due to a unit step func- 
tion applied to the filter and compare the result with the correspond- 
ing output of the ideal integrator. 


Note that Si(z) = 1.85 and Si(~) = 7/2. 

P3.5 Band-Pass Transmission 

Problem 14 An ideal band-pass filter has zero time delay and bandwidth 
B. An RF pulse of unit amplitude, duration T = 1/2B, and frequency f, 


is applied to the filter; the pulse is centered at £ = 0. Show that the filter 
output is given by 


y(t) = : [Si(27Bt + x) — Si(2xBt — n)] cos(27 f.t) 


where Si(*) is the sine integral. Sketch the waveform of y(t). 


Problem 15 Consider an ideal band-pass filter with center frequency f, 
and bandwidth B, as defined in Fig. P3.5. The carrier wave A cos(2z fot) 
is suddenly applied to this filter at time £ = 0. Assuming that |f, — fol is 
large compared to the bandwidth B, determine the response of the filter. 


lIH(f) | 


slope = —21t, 
fe 0 c 
B 


Figure P3.5 
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P3.6 Phase Delay and Group Delay 


Problem 16 The impulse response of a linear time-invariant system is 


defined by 
exp(—t), t>0 
1 
h(t) = 7 t=0 
0, t<0 


(a) Determine the phase delay t,(f) and group delay t,(f) of the system. 
(b) Plot both delays versus frequency f, and comment on your results. 


P3.7 Nonlinear Distortion 


Problem 17 Verify the frequencies and amplitudes of the intermodulation 
products listed in Table 3.1 for an input consisting of the sum of two 
sinusoidal waves of frequencies f, and f, and amplitudes A, and A). 


a CHAPTER FOUR 


SPECTRAL DENSITY 


SEEE uN Re SOBA BLATION 


l. this Chapter we complete the characterization of signals and systems 
by focusing on the energy or power of a signal. In so doing, we 
introduce the notion of spectral density, which defines the distribution of 
energy or power per unit bandwidth as a function of frequency. When 
dealing with energy signals, it is natural to use energy spectral density as 
the parameter of interest. Likewise, when dealing with power signals, 
power spectral density is used to characterize the signal. In this chapter 
we also introduce another important parameter called correlation, which 
may be viewed as the time-domain counterpart of spectral density. 
Throughout the chapter, we deal with real-valued energy and power 
signals. We begin the discussion with energy spectral density. 
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4.1 ENERGY SPECTRAL DENSITY 


Consider an energy signal g(t) defined over the interval -œ < t < œ, and 
let its Fourier transform or spectrum be denoted by G(f ). The signal g(t) 
is assumed to be real valued. The total energy of the signal is defined by 
(see Section 1.2) 


E= [ g(t) dt (4.1) 


Equation 4.1 is the standard formula for evaluating the energy E. Never- 
theless, there is another method based on the amplitude spectrum IG(f)I, 
which may also be used to evaluate the energy E. To develop this alternative 
method, we start with the relation (see Exercise 10, Chapter 2): 


ie 8i(1)gx(t) dt = i. G.(f)G2(—f) df (4.2) 


where g,(t) and g,(t) are a pair of energy signals with Fourier transforms 
G,(f) and G,(f), respectively. Let 


gi(t) = g2(t) = g(t) 


Correspondingly, we may set 


Gi(f) = G(f) 


and for real-valued signals, 


GSD Gy) 


Accordingly, we may simplify Eq. 4.2 as 
f eoa- [laine ag (4.3) 


where |G(f)| is the amplitude spectrum of the signal g(t). Equation 4.3 is 
known as the Rayleigh energy theorem. 

The Rayleigh energy theorem is important not only because it provides 
a useful method for evaluating energy, but also because it highlights |G (f)? 
as the distribution of energy of the signal g(t) in the frequency domain. It 
is for this reason that the squared amplitude spectrum |G(f)|? is called the 
energy spectral density or energy density spectrum. Using ¥,(f) to denote 
this new parameter, we may thus write 


PO) = |G(f)P (4.4) 
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EXAMPLE 1 SINC PULSE 


Consider the sinc pulse defined by 
g(t) = A sinc(2 Wt) 


The energy of this pulse equals 
Ee Í E ON dt (4.5) 


The integral on the right side of Eq. 4.5 is difficult to evaluate. We may 
obtain the desired result indirectly by applying the Rayleigh energy theo- 
rem. We start with the Fourier transform pair (see Example 6, Chapter 2) 


A sinc(2 Wt) == =. reo( 5) 


Hence, with the Fourier transform 


G(f) = = rea( 5) 


and rect?(f/2W) = rect(f/2W), the energy spectral density of the sinc 
pulse is given by 


yf) = (4) rea( 5] (4.6) 


Hence, the application of the Rayleigh energy theorem yields the result 


AV f° f 
E = (5) E rea( 56 df 
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EXERCISE 1 Show that the total area under the curve of sinc*(#) equals 
1; that is, ee a e a 


| : sin? (i) dt = 1 | a GS): 


PROPERTIES OF ENERGY SPECTRAL DENSITY 


The energy spectral density ¥,(f) has several properties that follow from 
the basic definition given in Eq. 4.4, which are formally described in the 
sequel. 


PROPERTY 1 


The energy spectral density of an energy signal g(t) is a nonnegative real- 
valued function of frequency; that is, 


Y(f)=0, forall f (4.9) 


This property follows directly from the fact that the amplitude spectrum 
|G(f)| of a signal g(r) is a nonnegative real function of the frequency f. 


PROPERTY 2 


The energy spectral density of a real-valued energy signal g(t) is an even 
function of frequency, that is, 


YA(—f) = ¥(F) (4.10) 


This property means that the energy spectral density of a real-valued 
signal is symmetric about zero frequency. It follows directly from the fact 
that the amplitude spectrum |G(f)| of a real-valued signal g(t) is an even 
function of the frequency f, as shown by 


GC fea 


PROPERTY 3 


The total area under the curve of energy spectral density of an energy signal 
g(t) equals the signal energy; that is, 


E= f WF) df (4.11) 
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Suppose that g(t) denotes the voltage of a source connected across a 
1-ohm load resistor. Then, the integral 


| i g(t) dt 


equals the energy E delivered by the source to the load. From Rayleigh’s 
energy theorem described by Eq. 4.3, the total area under the ¥,(f) curve 
equals the energy E. 


PROPERTY 4 


When an energy signal is transmitted through a linear time-invariant system, 
the energy spectral density of the output equals the energy spectral density 
of the input multiplied by the squared amplitude response of the system. 


This property follows from the frequency-domain description of a linear 
time-invariant system given in Eq. 3.23. Specifically, with X(f) denoting 
the Fourier transform of a signal x(t) applied to the input of a linear time- 
invariant system of transfer function H(f), the Fourier transform Y(f) of 
the signal y(t) produced at the output of the system is given by 


Y(f) = H(f)X(f) (4.12) 
Taking the squared amplitude of both sides of this equation, we get 
FOO = |ACA)P LXCP)P (4.13) 


Equivalently, we may write 


¥,(f) = |H(f)P ¥(f) (4.14) 


where ¥,(f) = |Y(f)P and ¥(f) = |X(f)P. The quantities ¥,(f) 
and ¥,(f) denote the energy spectral densities of the output y(t) and the 
input x(t), respectively. Equation 4.14 is a mathematical statement of 
Property 4. 
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: EXAMPLE 2 


A rectangular pulse of unit amplitude and unit duration is passed through 


; an ideal low-pass filter of bandwidth B, as illustrated in Fig. 4.1a. Part b : 
i of the figure depicts the waveform of the rectangular pulse. The amplitude : 
: response of the filter is defined by (see Fig. 4.1c) : 
; _ Jl, -B<sf<B : 
i OS k otherwise i 


The rectangular pulse constituting the filter input has unit energy. We wish 
: to evaluate the effect of varying the bandwidth B on the energy of the filter 
? output. 

We start with the Fourier transform pair: 


rect(t) == sinc(f) 


Ideal 
low-pass 
filter 


x(t) 


POOO0SSSS 00000 OOOH OOOH ODOC TTTTTTTTTTTTTTTTTTTTT] 
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(a) 

x(t) : 
: 1.0 ; 
; Pio l 
: 2 2 : 
: (6) ; 
; LH) ; 
: 1.0 
: = o g ; 
; (c) : 


Figure 4.1 
(a) Ideal low-pass filter. (b) Filter input. (c) Amplitude response of the filter. 


ENERGY SPECTRAL DENSITY 133 


This represents the normalized version of the Fourier transform pair given 
in Eq. 2.33. Hence, with the filter input defined by 


x(t) = rect(t) 
: its Fourier transform equals 
: X(f) = sine(f) 
The energy spectral density of the filter input therefore equals 


ep) 
sinc’(f) (4.15) 


This normalized energy spectral density is shown plotted in Fig. 4.2. 
To evaluate the energy spectral density ¥,(f) of the filter output y(¢), 
we use Eq. 4.14. We thus obtain 


¥(f) = |H(f)P EG) 


: ae LAD); =B s if <B 
: z in otherwise a) 
: 1.0 
: _ 0.6 
3 = 
: 2683 
; OA 
; 0 
0 1.0 2.0 3.0 


Normalized frequency, f 


Figure 4.2 
: Normalized energy spectral density of filter input x(t). 
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The energy of the filter output therefore equals 


E, = | Cf) af 
= |" wf) af 
=2 F Y. (f) df (4.17) : 

Substituting Eq. 4.15 in 4.17 yields 

p= za sinc’(f) df (4.18) 


Since the filter input is normalized to have unit energy, we may also į 
view the result given in Eq. 4.18 as the ratio of the energy of the filter ouput } 
to that of the filter input for the general case of a rectangular pulse of i 
arbitrary amplitude and arbitrary duration, processed by an ideal band- } 
pass filter of bandwidth B. Accordingly, we may also write : 


Energy of filter output 
Energy of filter input 


B : 

=) | sinc’(f) df (4.19) } 

D 3 

According to Fig. 4.1b, the rectangular pulse applied to the filter input has ; 
1.0 

0.8 


0.6 


ag 
P 


Output energy 
Input energy 


0.2 


0 10) 2.0 3.0 
Normalized bandwidth 


Figure 4.3 
Output energy-to-input energy ratio versus normalized bandwidth. 
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unit duration; hence, the variable f in Eq. 4.19 represents a normalized 
frequency. Equation 4.19 is plotted in Fig. 4.3. 

The graph of Fig. 4.3 shows that just over 90% of the total energy of a 
rectangular pulse lies inside the main spectral lobe of this pulse. 


eecceccvaseesesences 
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INTERPRETATION OF THE ENERGY SPECTRAL DENSITY 


Equation 4.14 is important because it not only relates the output energy 
spectral density of a linear time-invariant system to the input energy spec- 
tral density but it also provides a basis for the physical interpretation of 
the concept of energy spectral density itself. To be specific, consider the 
arrangement shown in Fig. 4.4a, where an energy signal x(t) is passed 


Narrow-band 
filter, 


H(f) 


(a) 


|A(f)| 


Figure 4.4 
(a) Circuit arrangement for measuring energy spectral density. (b) Idealized 
amplitude response of the filter. (c) Energy spectral density of filter output. 


136 SPECTRAL DENSITY AND CORRELATION 


through a narrow-band filter followed by an energy meter. Figure 4.4b 
shows the idealized amplitude response of the filter. That is, the amplitude 
response of the filter is defined by 


Af 


Af 
|H(f)| a fe E (4.20) 
0, otherwise 


We assume that the filter bandwidth 4 f is small enough for the amplitude 
response of the input signal x(t) to be essentially constant over the fre- 
quency interval covered by the passband of the filter. Accordingly, we may 
express the amplitude spectrum of the filter output by the approximate 
formula: 


IY(f)| = 1A) LX(A)| 
— —— < = — 
0, otherwise 
Correspondingly, the energy spectral density Y,(f) of the filter output 


y(¢) is approximately related to the energy spectral density ¥,(f) of the 
filter input x(f) as follows 


Pe eee 
Y (f) x | TAG) fi 2 2 = Ifl >= fe Ar 2 (4.22) 
0, otherwise 


This relation is illustrated in Fig. 4.4c, which shows that only the frequency 
components of the signal x(¢) that lie inside the narrow pass band of the 
ideal band-pass filter reach the output. From Rayleigh’s energy theorem, 
the energy of the filter output y(t) is given by 


E= | (A) df 
= 2)" wf) df 
= 28 (f) Af (4.23) 


where the multiplying factor of 2 accounts for the contributions of negative 
as well as positive frequency components. We may rewrite Eq. 4.23 as 


C (4.24) 


pecerecocancenoase 
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Equation 4.24 states that the energy spectral density of the filter input at 
some frequency f, equals the energy of the filter output divided by 2 4f, 
where 4 f is the filter bandwidth centered on f.. We may therefore interpret 
the energy spectral density of an energy signal for any frequency f as the 
energy per unit bandwidth, which is contributed by frequency components 
of the signal around the frequency f. 

The arrangement shown in the block diagram of Fig. 4.4a provides the 
basis for measuring the energy spectral density of an energy signal. Spe- 
cifically, by using a variable band-pass filter to scan the frequency band of 
interest, and determining the energy of the filter output for each midband 
frequency setting of the filter, a plot of the energy spectral density versus 
frequency is obtained. 


4.2 CORRELATION OF ENERGY SIGNALS 


The energy spectral density is an important frequency-dependent param- 
eter of an energy signal. With the interplay between time-domain and 
frequency-domain descriptions of a signal that we have become accustomed 
to, it is natural for us to seek the time-domain counterpart of energy spectral 
density. From the defining equation (4.4), we have 


¥(f) = G(f)G*(f) (4.25) 


where the signal g(t) and its Fourier transform G(f) are related by 
g(t) == G(f) 


Equation 4.25 states that the energy spectral density ¥,(f) of an energy 
signal g(t) equals the product of G(f), the Fourier transform of g(t), and 
its complex conjugate, G*(f). Hence, given G(f), we need to perform 
two frequency-domain operations to get ¥,(f), namely, complex conju- 
gation and multiplication. This suggests that we may determine the inverse 
Fourier transform of ¥,(f) by making use of two fundamental properties 
of the Fourier transform (see Section 2.3): 


1. The complex conjugation property, according to which time reversal of 
a real-valued signal translates to complex conjugation of its Fourier 
transform. 

2. The time-domain convolution property, according to which the con- 
volution of two signals translates to the multiplication of their Fourier 
transforms. 


Accordingly, we may formulate the following Fourier transform pair: 


g(t) 3r 8-1) = Gf) G*(f) (4.26) 
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R,(r) 
Integrator 


Adjustable 
delay + 
Figure 4.5 


Circuit arrangement for measuring the autocorrelation function of an energy signal. 


where +> denotes convolution. For the convolution on the left side of 
Eq. 4.26, we have purposely used z as the time variable of the energy 
signal of interest, because we wish to reserve the use of time t as the dummy 
variable of the integral describing the convolution there. Specifically, we 
define the time-domain convolution on the left side of Eq. 4.26 as 


R,(t) = g(t) fy g(-7) 
a oc = er (4.27) 


The t-dependent parameter R,(z) is called the autocorrelation function 
of the energy signal g(¢). In the defining equation (4.27), the time function 
g(t — t) represents a delayed version of the signal g(t), and R,(t) provides 
a measure of the similarity between the waveforms of the time functions 
g(t) and g(t — t). In particular, the time lag or time delay t plays the role 
of a scanning or searching parameter. This role is highlighted in the block 
diagram of Fig. 4.5, which provides the basis for measuring the autocor- 
relation function R,(z). 


EXERCISE 3 Show that the definition for the autocorrelation function 
R(t) may also be formulated as A a eS 


RO = f eet dear (4.28) 


PROPERTIES OF THE AUTOCORRELATION FUNCTION OF 
ENERGY SIGNALS 


The autocorrelation function of a real-valued energy signal has several 
useful properties. They follow directly from the defining equation (4.27) 
or (4.26), from which the definition of autocorrelation function originated. 
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PROPERTY 1 


The autocorrelation function of a real-valued energy signal g(t) is a real- 
valued even function, as shown by 


R,(—1) = R(t) (4.29) 


This property follows directly from Eq. 4.27. The implication of this 
property is that the autocorrelation function exhibits symmetry about the 
origin. 

PROPERTY 2 


The value of the autocorrelation function of an energy signal g(t) at the origin 
is equal to the energy of the signal; that is, 


R,(0) = E (4.30) 


This result is obtained by putting t = 0 in Eq. 4.27. 


PROPERTY 3 


The maximum value of the autocorrelation function of an energy signal g(t) 
occurs at the origin, as shown by 


|Ro(z)| = R(0), for all z (4.31) 
To prove this property, we start with the observation that for any q, 
[s() +g- )P > 0 
Equivalently, we may write 
+2g(t)g(t — 1) <g°t) + grt — 1) 


Integrating both sides of this relation with respect to time ¢ from —~ to 
+o, and using Eqs. 4.27 and 4.30, we get the result given in Eq. 4.31. 

According to Property 3, the degree of similarity between the signal 
g(t) and its time-delayed version of g(t — t) attains its maximum value at 
t = 0. This is intuitively satisfying. 


PROPERTY 4 


For an energy signal g(t), the autocorrelation function and energy spectral 
density form a Fourier transform pair; that is, 


R,(t) = YF) (4.32) 


This property follows directly from Eqs. 4.25 through 4.27. 
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s for the Fourier transform 


aD) He 


R, (2) 
¥,(0) 


EXAMPLE 3 SINC PULSE (CONTINUED) 


From Example 1, the energy spectral density of the sinc pulse A sinc(2 Wt) 
is given by (see Eq. 4.6) 


7 Pf) = (4) ree( 5) 


Taking the inverse Fourier transform of Y.(f), we find that the autocor- 
relation function of the sinc pulse A sinc(2W?) is given by 


2 


R,(t) = oe sinc(2Wr) (4.33) 


which has a similar waveform to the sinc pulse itself. 


Toc ocn nee eSecroesneceesesscessceccnecesceconvscnssavececsessccessencsascoussececccesacousesseredcarncsdeneereeceenen: 


CROSS-CORRELATION OF ENERGY SIGNALS 


The autocorrelation function provides a measure of the similarity between 
a signal and its time-delayed version. In a similar way, we may use the 
cross-correlation function as a measure of the similarity between a signal 
and the time-delayed version of a second signal. Let g(t) and g,(t) denote 
a pair of real-valued energy signals. The cross-correlation function of this 
pair of signals is defined by 


Ra(s) = [gente — 2) at (4.34) 


We see that if the two signals g,() and g(t) are somewhat similar, then 
the cross-correlation function R(t) will be finite over some range of z, 
thereby providing a quantitative measure of the similarity, or coherence, 
between them. The energy signals g, (t) and g,(t) are said to be orthogonal 
over the entire time interval if R,,(0) is zero, that is, if 


F sxe. ar = 0 (4.35) 


“ EXERCISE 5 Prove the property T prom comeiation. A nctions S desore ' 
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Equation 4.34 defines one possible value for the cross-correlation func- 
tion for a specified value of the delay variable t. We may define a second 
cross-correlation function for the energy signals g,(t) and g,(f) as 


Rali) = |” gal gult ~ 2) at (4.36) 


From the definitions of the cross-correlation functions R(t) and Ry (t) 
just given, we obtain the fundamental relationship 


Ry(t) = Ra(-7) (4.37) 


Equation 4.37 indicates that unlike convolution, correlation is not in gen- 
eral commutative, that is, R(t) # Ra (1). 

Another important property of cross-correlation is shown by the Fourier 
transform pair 


Ry(t) — Gf) Gr(f) (4.38) 


This relation is known as the correlation theorem. The correlation theorem 
states that the cross-correlation of two energy signals corresponds to the 
multiplication of the Fourier transform of one signal by the complex con- 
jugate of the Fourier transform of the other. 


~ EXERCISE6 Prove the correlation theor 


4.3 POWER SPECTRAL DENSITY 


Consider next the case of a power signal g(t), which remains finite as time 
t approaches infinity. We assume g(t) to be real valued. The average power 
of the signal is defined by (see Section 1.2) 


P = tim = | 9% at (4.39) 


To develop a frequency-domain description of power, we need to know 
the Fourier transform of the signal g(t). However, this may pose a problem, 
because power signals have infinite energy and may therefore not be Fou- 
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rier transformable. To overcome the problem, we consider a truncated 
version of the signal g(t). In particular, we define 


t 
&r(f) = g(t) ree( 5) 


Gy -~T<xtsT 
= if otherwise 2) 


As long as T is finite, the truncated signal g(r) has finite energy; hence 
gr(t) is Fourier transformable. Let G;(f) denote the Fourier transform of 
g7(t); that is, 


gr(t) == G,(f) 


Using the definition of g;(t), we may rewrite Eq. 4.39 for the average 
power P in terms of g7(t) as 


ae 
= => 4.41 
Pie | sO a oe 


Since g7(t) has finite energy, we may use the Rayleigh energy theorem to 
express the energy of gr(t) in terms of its Fourier transform G,(f) as 


[si a= f icp af (4.42) 


where |G;(f)| is the amplitude spectrum of g;(t). Accordingly, we may 
rewrite Eq. 4.41 in the equivalent form 


: 1 Bs 
P = tim 5-.[ CAP) df (4.43) 


As T increases, the energy of g7(t) increases. Correspondingly, the energy 
spectral density |G;(f)|? increases with T. Indeed as T approaches infinity, 
so will |G;(f)|’. However, for the average power P to be finite, IGER) 
must approach infinity at the same rate as T. This requirement ensures the 
convergence of the integral on the right side of Eq. 4.43 in the limit as T 
approaches infinity. This convergence, in turn, permits us to interchange 
the order in which the limiting operation and integration in Eq. 4.43 are 
performed. We may thus rewrite this equation as 


co 1 
P= f tim 5 1Gr(AP df (4.44) 
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Let the integrand be denoted by 
eel j 
S,(f) = lim = |G;(f)| (4.45) 
Too 2T 


The frequency-dependent function S,(f) is called the power spectral den- 
sity or power spectrum of a power signal, and |G;(f)|?/2T is called the 
periodogram’ of the signal. 


OOOOH OTOH OEE EOEEEOEHOOEROOO HOSE EST OOOO SONOS OHO TSOTSODESEESEH SET ES ESOS ESEHOCOESS DES SSOSSESSHHSS HOS OOSOSOSOOESOOSEO ES SOOED 


EXAMPLE 4 MODULATED WAVE 


Consider the modulated wave 


x(t) = g(t) cos(2zf,t) (4.46) 


where g(t) is a power signal band-limited to B hertz. We refer to x(t) as 
a “modulated wave” in the sense that the amplitude of the sinusoidal 
“carrier” of frequency f, is varied linearly with the signal g(t). We wish to 
find the power spectral density of x(¢) in terms of that of g(t), given that 
the frequency f, is larger than the bandwidth B. 

Adapting the formula of Eq. 4.45 to the situation at hand, we may define 
the power spectral density of the modulated wave x(t) as 


S.(f) = lim 5 X) (4.47) 


where Xz7(f) is the Fourier transform of x;(t), the truncated version of : 
x(t). From Eq. 4.46, we have 


X7(t) = gr(t) cos(27 f-t) (4.48) 
where the truncated signal g7(¢) is itself defined in Eq. 4.40. Since 
; 1 À l 
: cos(27 f.t) = 5 [exp(j2zf.t) + exp(—j2zf,t)] (4.49) 


it follows from the frequency-shifting property of the Fourier transform 
that 


XAP) = FIGE = S) + Golf + FO (4.50) 


where G7(f) is the Fourier transform of gz(¢). 


'The periodogram is a misnomer since it is a function of frequency not period. 
Nevertheless, the term has wide usage. It was first used by statisticians to look for 
periodicities such as seasonal trends in data. 
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Given that f. > B, we find that Gr(f — f.) and G;(f + f.) represent 
nonoverlapping spectra; their product is therefore zero. Accordingly, using 
Eq. 4.50 to evaluate the squared amplitude of X;(f), we get 


X(N? = FGF = SI + IGF + AE, fe >B (4.51) 


Finally, substituting Eq. 4.51 in 4.47, and then using the definition of Eq. 
4.45 for the power spectral density of the power signal g(t), we get the 
desired result: 


PROPERTIES OF POWER SPECTRAL DENSITY 


The role of power spectral density for power signals is similar to that of 
energy density for energy signals. Indeed, the power spectral density has 
properties that parallel those of the energy spectral density. In the sequel, 
we present the properties of power spectral density without proof; these 
properties may be verified by using arguments similar to those used in 
Section 4.1 for verifying the properties of energy spectral density. 


PROPERTY 1 


The power spectral density of a power signal g(t) is anonnegative real-valued 
function of frequency; that is, 


S,(7) = 0, for ail f (4.53) 


PROPERTY 2 


The power spectral density of a real-valued power signal g(t) is an even 
function of frequency; that is, 


S,(-f) = Saf) (4.54) 
PROPERTY 3 


The total area under the curve of the power spectral density of a power signal 
g(t) equals the average signal power; that is, 


P= |" Sf) df (4.55) 


eecccoescceosce 


. 
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PROPERTY 4 


When a power signal is transmitted through a linear time-invariant system, 
the power spectral density of the output equals the power spectral density 
of the input multiplied by the squared amplitude response of the system. 
That is, if Sf) is the power spectral density of a power signal x(t) applied 
to a linear time-invariant system of transfer function H( f), the power spectral 
density S,( f) of the power signal y(t) produced at the output of the system 
is defined by 


SAF) = |HP) SAF) (4.56) 


where |H(f)| is the amplitude response of the system. 


ii EXERCISE 7 Justify the validity of the input-output relation described in 


INTERPRETATION OF POWER SPECTRAL DENSITY 


The input-output relation of Eq. 4.56 provides a basis for the physical 
interpretation of power spectral density, and therefore its measurement. 
Just as we did for the interpretation of energy spectral density, suppose a 
power signal x(f) is applied to a band-pass filter followed by a power meter 
as in Fig. 4.6a. The filter has a narrow bandwidth 4f centered on some 
frequency f., as in Fig. 4.656. Application of Eq. 4.56 yields the power 
spectral density of the resulting filter output y (t) approximately as follows 


0, otherwise 


The average power of the filter output y(t) is therefore approximately given 
by 


P, = 2S,(f.) Af (4.58) 


The evaluation of S,(f) is illustrated in Fig. 4.6c. Equivalently, we may 
write 


uy 


T 


(4.59) 


In other words, the power spectral density of the filter input x(t) at some 
frequency f. is equal to the average power of the filter output divided by 
24 f, where 4f is the bandwidth of the filter centered on f.. The factor of 
2 accounts for the contributions of negative as well as positive frequency 
components. 
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Coerccovercnsssceeocos 


Narrow-band 
filter 


(a) 


|A(p)| 


(c) 


Figure 4.6 

(a) Circuit arrangement for measuring power spectral density. (b) idealized 
amplitude response of narrow-band filter. (c) Power spectral density of the filter 
output. 


Equation 4.59 provides the basis for the measurement of power spectral 
density. Specifically, by varying the midband frequency f, of the band-pass 
filter in Fig. 4.6a, and measuring the average power of the filter output 
for each setting of f., we may measure the power spectral density of a 
power signal (applied to the filter input) over a frequency band of interest. 


4.4 CORRELATION OF POWER SIGNALS 


We may develop a formula for the autocorrelation function of power signals 
by following a procedure similar to that described for the case of energy 
signals in Section 4.2. Specifically, we start with the defining equation (4.45) 
for the power spectral density S,(f) of a power signal g(t), and rewrite it 
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in the form 


al 
S,(f) = lim zz Gr(f)GF(F) (4.60) 


where G,(f) is the Fourier transform of the truncated version g7(t) of the 
power signal g(t). Next, we use the Fourier transform pair 


&r(t) > &r(-1t) == Gop Gr(f) (4.61) 


Multiplying both members of this pair by the factor 1/2T and then taking 
the limit as T approaches infinity, we have 


lim 5 grlt) fp 8r(— ) = lin y Cr(f)GF(f) (4.62) 


The function on the right side of this pair is recognized as the power spectral 
density of the power signal g(t). Accordingly, we adopt the function on 
the left side of Eq. 4.62 as the autocorrelation function of the power signal 
g(t), and thus write 


R,(t) = lim a | ” gp(t)er(t — 1) dt (4.63) 
Too 2T —oo 


We may formulate the autocorrelation function R,(z) in terms of the power 
signal g(t) itself by using the definition given in Eq. 4.40 for the truncated 
signal g7(t). By so doing, we define the autocorrelation function of a power 
signal g(t) as follows 


R,(t) = lim 7 ae O d (4.64) 


PROPERTIES OF THE AUTOCORRELATION FUNCTION OF 
POWER SIGNALS 


The autocorrelation function of a power signal has properties that are 
similar to those of the autocorrelation function of energy signals. Indeed, 
by following arguments similar to those presented in Section 4.2, we may 
readily establish the following properties of the autocorrelation function 
of power signals, which are presented without proof. 


PROPERTY 1 


The autocorrelation function of a real-valued power signal g(t) is a real-valued 
even function, as shown by 


R,(—1) = R(t) (4.65) 


148 SPECTRAL DENSITY AND CORRELATION 


PROPERTY 2 


The value of the autocorrelation function of a power signal g(t) at the origin 
is equal to the average power of the signal; that is, 


R,(0) = P (4.66) 


PROPERTY 3 


The maximum value of the autocorrelation function of a power signal g(t) 
occurs at the origin, as shown by 


IR (t) = R,(0) ` (4.67) 


PROPERTY 4 


For a power signal g(t), the autocorrelation function and power spectral 
density form a Fourier transform pair; that is, 


R,(t) —= S,(f) (4.68) 


Equation 4.68 states that the power spectral density S,(f) of a power 
signal g(t) is the Fourier transform of the autocorrelation function R,(t) 
of the signal, as shown in the expanded form: 


SP) = [7 RO exp(=j2afc) de (4.69) 


Equation 4.68 also states that the autocorrelation function R,(t) is the 
inverse Fourier transform of the power spectral density S,(f), as shown 
in the expanded form: 


Ree) = | Sf) expi2afe) df (4.70) 


Equations 4.69 and 4.70 are known as the Einstein-Wiener-Khintchine 
relations.’ Given the autocorrelation function R,(t), we may use Eq. 4.69 
to compute the power spectral density S,(f). Conversely, given the power 


"Traditionally, Eqs. 4.69 and 4.70 have been referred to in the literature as the 
Wiener-Khintchine relations in recognition of pioneering work done by Wiener and 
Khintchine; for their original papers, see Wiener (1930) and Khintchine (1934). A 
recent discovery of a forgotten paper by Albert Einstein on time-series analysis 
(delivered at the Swiss Physical Society's February 1914 meeting in Basel) reveals 
that Einstein had discussed the autocorrelation function and its relationship to the 
spectral content of a time series many years before Wiener and Khintchine. For this 
very brief paper, see Einstein (1914). An English translation of Einstein's paper is 
reproduced in the /EEE Acoustics, Speech, and Signal Processing Magazine, vol. 4, 
October 1987. This particular issue also contains articles by W. A. Gardner and 

A. M. Yaglom, which elaborate on Einstein's original work. 
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spectral density S,(f), we may use Eq. 4.70 to compute the autocorrelation 
function R,(t). 


EXAMPLE 5 


Consider again the modulated wave x(t), defined in Eq. 4.46, reproduced 
here for convenience: 


x(t) = g(t) cos(2zf.t) 


The signal g(t) is a power signal band-limited to B hertz, where B < f.. 
In this example, we evaluate the autocorrelation function of x(t) in terms 
of that of g(t). 

We do the evaluation by using Property 4 of the autocorrelation function, 
namely, the fact that autocorrelation function and power spectral density 
form a Fourier transform. From Eq. 4.52 of Example 4, we have 


SAP) = EISE - F) + SCF + £31 


\ 


Therefore, taking the inverse Fourier transform of both sides of the equa- 
tion, we get 


Ree) = È [Ry(0) exp(2nfr) + R(t) exp(—j2xF.-0) 


= ZRC) cos(2nf,t) (4.71) 


which is the desired result. 


Perr rr rrr rrr rite 


CROSS-CORRELATION OF POWER SIGNALS 


We complete the discussion of correlation of power signals by considering 
their cross-correlation. Let g,(t) and g(t) denote a pair of power signals. 
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We define the cross-correlation between g,(t) and g,(t) as 
elie 
Rol) = tim 57 | gildgalt ~ 2) at (4.72) 
T>% y T Syy 


In a similar way we may define a second cross-correlation function R, (t). 
The pair of power signals g,(t) and g,(t) are said to be orthogonal over 
the entire time interval if 


i= i " Ome = 0 (4.73) 
T=% 2 TT 3 


4.5 FLOWCHART SUMMARIES 


In this section we summarize the significance of the time-frequency rela- 
tions derived for energy and power signals. 

Given an energy signal g(¢) of Fourier transform G(f), we may sum- 
marize this relationship and its interplay with the formula of Eq. 4.4 for 
the energy spectral density Y,(f) and that of Eq. 4.27 for the autocorre- 
lation function R,(t) as in Fig. 4.7. This chart clearly shows that whatever 
operation or sequence of operations is used to obtain the autocorrelation 
function R,(t) or the energy spectral density W (f), that operation or 
sequence of operations is irreversible. The implication of this is that when 
a signal g(¢) is converted to R,(t) or ¥,(f), in general, information is lost 
about the original signal g(t) or its Fourier transform G(f). In going from 
g(t) to R,(t), dependence on the physical time t is destroyed. In going from 
G(f) to ¥,(f), information on the phase spectrum of the signal is de- 
stroyed. This means that if two (or more) different signals have the same 
amplitude spectrum but different phase spectra, then they will have the 
Same energy spectral density or, equivalently, the same autocorrelation 
function. In other words, for a given energy signal g(t), there is a unique 
energy spectral density ¥,(f) or, equivalently, a unique autocorrelation 
function R,(t). The converse of this statement, however, is not true. 

The flowchart of Fig. 4.7 shows that given the energy signal g(t), we 
may compute the energy spectral density P,(f) in one of two equivalent 
ways: 


1. We compute the Fourier transform G(f), and then use the definition 
of Eq. 4.4. 

2. We compute the autocorrelation function R,(t) using Eq. 4.27, and then 
compute the Fourier transform of R,(z). 


The interrelations between time-domain and frequency-domain descrip- 
tions of power signals are analogous to those for energy signals. In partic- 
ular, for a power signal g(t) we may draw a chart similar to that of Fig. 
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a(t) —————= G(f) 


| 


Rir) = l) 


Figure 4.7 
Flowchart summary of interrelations between time-domain and frequency-domain 
descriptions of energy signals. 


4.7, except that the chart is now based on a truncated version g7(t) of the 
power signal. The point to note is that information is lost in the process 
of computing and retaining only the autocorrelation function R,(t) of the 
power signal or its power spectral density ¥,(f). Moreover, given the signal 
g(t), we may compute the power spectral density S,(f) using one of two 
equivalent procedures: 


1. We compute the Fourier transform G,(f) of the power signal g(t) for 
the interval — T < t < T for large T, and then use Eq. 4.45 to compute 
the power spectral density S,(f). 

2. We use Eq. 4.63 to compute the autocorrelation function R,(t), and 
then take the Fourier transform of R,(z). 


g EXERCISE 10 Given the energy signal g(t), outline the two procedures 
- that may be used to compute the autocorrelation function R,(t). 


EXERCISE 11 Given the power signal g(t), outline the two procedures 


_ that may be used to compute the autocorrelation function R(t). 


Seevsccasoseoroce 


4.6 SPECTRAL CHARACTERISTICS OF PERIODIC SIGNALS 


The definitions of power spectral density and autocorrelation function for 
power signals given in Eqs. 4.60 and 4.64 take on special forms for the 
case of periodic signals. These signals constitute an important class of power 
signals. Consider a periodic signal g,(t) of period To, represented in terms 
of its complex Fourier series as 


ao = 3 « exo(! azne) (4.74) 


n=-% 


where the c, are complex Fourier coefficients. For the situation at hand, 
the time average in the defining equation (4.39) for the average power of 
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the signal may be taken over one period, as shown by 


pee f M202) dt (4.75) 


To J-ty2 


Correspondingly, the formula for the power spectral density given in Eq. 
4.60 takes on a discrete form defined in terms of the complex Fourier 
coefficients as 


Sf) = ` (a a(i -2) (4.76) 


n= 


Naturally, the power spectral density S, (f) has all the properties listed in 
Section 4.3. Moreover, it is a discrete function of frequency, which is a 
consequence of the periodic nature of the signal g,(t). Since the total area 
under a curve of power spectral density equals the average power, we may 
define the total average power of the periodic signal g,(t) in terms of its 
frequency-domain description as 


P= > lof (4.77) 


n=% 


This relation is known as Parseval’s power theorem. It states that the av- 
erage power of a periodic signal g,(t) is equal to the sum of the squared 
amplitudes of all the harmonic components of the signal g,(t). Note that 
the Parseval power theorem, as with the Rayleigh energy theorem, requires 
knowledge of the amplitude spectrum only. 

The power spectral density of Eq. 4.76 has a delta function at zero 
frequency, which is weighted by |c,|?. The presence of this delta function 
implies that the periodic signal g,(t) has dc power, given by 


Br = [co]? (4.78) 
The coefficient cy equals the mean or average value of the periodic signal 


g(t); that is, 


1 (T2 
a | g,(t) dt (4.79) 
To J-1y2 


T 


The ac power of the periodic signal g,(t) is defined by the sum of the 
weights associated with the remaining delta functions in S,,(f), as shown 
by 


Pa kal (4.80) 
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The square root of P, defines the root mean square (rms) value of the 
signal. Naturally, the sum of dc power Pa and ac power P, equals the 
total average power P. 

When the power signal of interest is periodic, the integrand in the 
defining equation (4.64) for the autocorrelation function R,(t) of the signal 
is likewise periodic. Hence, the time average in this formula may be taken 
over one period. Thus, we may express the autocorrelation function of a 
periodic signal g,(t) of period To as 


il (pe 
R) = 7 ike. g,(t)g,(t - t) dt (4.81) 


The autocorrelation function R, (t) exhibits all the properties listed in 
Section 4.4 for the autocorrelation function of power signals. In addition, 
the autocorrelation function R, (t) is periodic with the same period as the 
periodic signal g,(t) itself; that is 


ROR Cnh n=1,2,..-, (4.82) 


POO ORC 0000000000000000 0000000OCOOOOOOOO0 000000000000 COO0000000000000000000000 


EXAMPLE 6 SINUSOIDAL WAVE 


Consider the sinusoidal wave 
g(t) = A cos(27f.t + 0) (4.83) 
which is plotted in Fig. 4.8a; the period Tọ = 1/f,. The requirement is to 
evaluate the power spectral density, average power, and autocorrelation 
function of this sinusoidal wave. 
To express the given sinusoidal wave as a complex Fourier series, we 


use the formula for a cosine function in terms of a pair of complex ex- 
ponentials. We thus write 


g(t) = c exp(j2nf,t) + c-ı exp(—j2zf.t) ; 


where 
A ; 
cı = 5 exp(/9) 


and 
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A2/4 


1» 


(c) 


Figure 4.8 at 
(a) Sinusoidal wave. (b) Power spectral density. (c) Autocorrelation function. 


Hence, the use of Eq. 4.76 yields the power spectral duality: 
A?’ A? 
SOE OU O g’ + fe) (4.84) 


That is, the power spectral density of a sinusoidal wave consists of a pair 
of delta functions located at f = + fe, both of which are weighted by the 
factor A?/4, as depicted in Fig. 4.8b. Note that the power spectral density 
is independent of the phase 6 of the sinusoidal wave. 

By evaluating the total area under the power spectral density S, (f), we 
obtain the average power of the sinusoidal wave as 


A? i 
Pe (4.85) 
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Finally, the use of Eq. 4.81 yields the autocorrelation function of the 
given sinusoidal wave as 


1/2f, 
R,(t) = Af. | cos(2nf.t + 0) cos(2nf.t — 2nf.c + 6) dt 


Vee. 


Af [12 
oom | [cos(2zf.t) + cos(4zf,t — 2nf,t + 26)] dt 
nbsp 


= © cos(2nf) (4.86) 


Equation 4.86 is plotted in Fig. 4.8c. It shows that the autocorrelation ; 
function of a sinusoidal wave is a sinusoidal function of t, with the same : 
period as the given sinusoidal wave. Moreover, putting t = 0 in Eq. 4.86, : 
we find that R, (0) = P, as expected. 


EXAMPLE 7 SQUARE WAVE 


Consider next the square wave of Fig. 4.9a, one period of which is defined ; 
by ; 


A, ae sts k 
&() = A 5 (4.87) 
0, for the remainder of the period 


The requirement is to determine the power spectral density and autocor- i 
relation function of this square wave. : 

In Example 1, Chapter 2, we derived the formula for the complex : 
Fourier coefficient c, of a rectangular pulse train with arbitrary duty cycle; ; 
the result is given in Eq. 2.19. The square wave described here has a duty } 
cycle of one-half. Hence, adapting Eq. 2.19 for this duty cycle, we find į 
that the complex Fourier coefficient of the square wave of Fig. 4.9a is given } 
by 


G = £ sine(2) (4.88) 


Substituting Eq. 4.88 in 4.76 yields the desired power spectral density of 
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e@ecvccescecse Seeccesvccccessscocenvevese 


2T, 


Ep (t) 
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(a) Square wave. (b) Power spectral density. (c) Autocorrelation function. 


Figure 4.9 
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Ept) 


p(t — T)/8) 


Figure 4.10 
The computation of autocorrelation function R,, (t) for lag t = T)/8. . 


a delay t = T/8. Parts a, b, and c of the figure present plots of the 
square wave g,(t), its delayed version g,(t — T)/8), and the product 
g,(t)g,(t — To/8), respectively, for the period — (7/2) < t < (7/2). The 
area under the product g,(t)g,(¢ — To/8) for this period is shown shaded 
in Fig. 4.10c. Evaluating this area and scaling it by the factor 1/7), 


we get 
T\_ 3A? 
r, (2) ~ 8 


eccccccceccos 


Perecccccoeccsnssecsseocesecs 
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Proceeding in a similar manner for other values of delay t, we obtain 


2 
0 
R, (1) = A? a. Beet (4.90) 
— {1 - =], V=7= 
2 i 2 


Recognizing that the autocorrelation function of a periodic wave with pe- 
riod T is also periodic with the same period, we find that the use of Ear 
4.90 yields the plot shown in Fig. 4.9c for the autocorrelation function of 
the given square wave. 


EXERCISE 13 Use Eq. 4.89 to illustrate the properties of the power spec- 
tral density of a periodic signal. z 


EXERCISE 14 Use Eq. 4.90 to illustrate the properties of the autocor- 
relation function of a periodic signal. 


EXERCISE 15 Determine the power spectral density and autocorrelation 
function of a rectangular wave, one period of which is defined by 


To 
S<t<— 
8 8 


iin SS 
Belt) for the remainder of the period 


0, 


4.7 SPECTRAL CHARACTERISTICS OF RANDOM SIGNALS AND NOISE 


Random signals constitute another important class of power signals. We 
Say a signal is random if there is uncertainty about the signal before it 
actually occurs. Such a signal may be viewed as belonging to an ensemble 
of signals, the generation of which is governed by a mechanism that is 
probabilistic in nature. Hence, no two signals in the ensemble exhibit the 
same variation with time. Each waveform (signal) in the ensemble is re- 
ferred to as a sample function, and the ensemble of all possible sample 
functions is referred to as a random process. 

Let x(t) denote a sample function of a random process X(t). Figure 
4.11a shows a plot of the waveform of x(t). Since x(t) is a power signal, 
its Fourier transform does not exist. This necessitates dealing with a trun- 


Sceccsssesccceccesecccececen 
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x(t) 


(a) 


x(t) 


(b) 


Figure 4.11 
(a) Sample function of a random process. (b) Truncated version of the sample 
function. 


cated version of the sample function, namely, 


SO =r] 
a= F otherwise a 


Figure 4.11b depicts the truncated signal x(t). From the discussion pre- 
sented in Section 4.3, we note that the time average power spectral density 
of the sample function x(t) over the interval -T = t < T is |X;,(f)|*/2T, 
where X7(f) is the Fourier transform of x7(t). This time-averaged power 
spectral density depends on the particular sample function x(t) drawn from 
the random process X(t). Accordingly, we must perform an ensemble av- 
eraging operation, and then take the limit as T approaches infinity. The 
value of frequency f is held fixed while averaging over the ensemble. The 
‘ensemble averaging operation requires using the probability distribution 
of the ensemble.° For the purpose of our present discussion, it is sufficient 
to acknowledge the ensemble averaging operation by using the operator 
E, commonly referred to as the expectation operator. We thus write the 
ensemble-averaged or mean value of |Xr(f) simply as E[|X7(f)|’] and the 


3The issue of ensemble averaging is considered in Chapter 8. 
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corresponding power spectral density of the random process X (t) as 
m l 
Sx(f) = lim 57 E[|X7(f))] (4.92) 
Too 2T 


It is important to note that in Eq. 4.92 the ensemble averaging must be 
performed before the limit is taken. Also, we have used an uppercase letter 
as the subscript for the power spectral density in Eq. 4.92 to distinguish 
this definition of power spectral density for a random process from that 
for a power signal of deterministic form. 

Our involvement with random processes in‘ this book will be in the 
context of noise analysis of communication systems. The term noise is used 
customarily to designate unwanted waveforms that tend to disturb the 
transmission and processing of signals in communication systems, and over 
which we have incomplete control. In practice, we find that there are many 
potential sources of noise in a communication system. The sources of noise 
may be external to the system (e.g., atmospheric noise, galactic noise, 
man-made noise), or internal to the system. The second category includes 
an important type of noise that arises Owing to spontaneous fluctuations of 
current or voltage in electrical circuits. This type of noise, in one way or 
another, is present in every communication system and represents a basic 
limitation on the reliable transmission of information. It Originates at the 
front end of the receiver part of the system; hence, it is commonly referred 
to as receiver noise.* It is also referred to as channel noise. 


WHITE NOISE 


The noise analysis of communication systems is customarily based on an 
idealized form of a noise process called white noise, the power spectral 
density of which is independent of frequency. The adjective white is used 
in the sense that white light contains equal amounts of all frequencies 
within the visible band of electromagnetic radiation. We denote the power 
spectral density of a white-noise process W(t) as 


Sy(f) = (4.93) 


where the factor 1/2 has been included to indicate that half the power is 
associated with positive frequencies and half with negative frequencies, as 
illustrated in Fig. 4.12a. The dimensions of N, are in watts per hertz. The 
parameter No is usually measured at the input stage of the receiver of a 
communication system. 


“For a discussion of various types of noise encountered in communication systems, 
see Appendix C. 
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(b) 


Figure 4.12 
Characteristics of white noise. (a) Power spectral density. (b) Autocorrelation 
function. 


The absence of a delta function in the power spectral density of Fig. 
4.12a at the origin means that the white noise so described has no dc 
power. That is, its mean or average value is zero. 

Since the autocorrelation function is the inverse Fourier transform of 
the power spectral density, it follows that for white noise 


Ro) = raça) (4.94) 


That is, the autocorrelation function of white noise consists of a delta 
function weighted by the factor Nọ/2 and occurring at t = 0, as in Fig. 
4.12b. We note that Ry(z) is zero for t # 0. Accordingly, any two different 
samples of white noise, no matter how close together in time they are 
taken, are uncorrelated. 

Strictly speaking, white noise has infinite average power and, as such, 
it is not physically realizable. Nevertheless, white noise has convenient 
mathematical properties and therefore is useful in system analysis. 

The utility of a white-noise process is parallel to that of an impulse 
function or delta function in the analysis of linear systems. The effect of 
an impulse is observed only after it has been passed through a system with 
finite bandwidth. Likewise, the effect of white noise is observed only after 
passing through a system with finite bandwidth. We may state, therefore, 
that as long as the bandwidth of a noise process at the input of a system 
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is appreciably larger than that of the system itself, we may model the noise 
process as white noise. 


EXAMPLE 8 IDEAL LOW-PASS FILTERED WHITE NOISE 


Suppose that a white-noise process W(t) of zero mean and power spectral 
density No/2 is applied to an ideal low-pass filter of bandwidth B and a 
passband amplitude response of 1. The power spectral density of the noise 
process N(t) appearing at the filter output is therefore (see Fig. 4.132) 


No 
Sofas oo ee (4.95) 
0, lfl>B 


Syf) 


Figure 4.13 
Characteristics of low-pass filtered white noise. (a) Power spectral density. 
(b) Autocorrelation function. 
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the power spectral density shown in Fig. 4.13a: 


Roe) = [" M exp(j2nfr) df 
= NoB sinc(2Br) (4.96) 


This autocorrelation function is plotted in Fig. 4.13b. We see that Ry(t) 
has its maximum value of N,B at the origin, and it passes through zero at 
T= =n/Z2B, wheren = 1,2,3,.... 


COSOCSSHOTSO TOSSES HSOH ESOS HT SOSSSOLOSOSSHSTOS OSS SSO OSESHESORSSOSSOOSOOSOS ESOT OSHS DESO THOSHSE TOTS OTTTSSOSTSO ST ESOOSOSOSSOOSD 


EXAMPLE 9 RC LOW-PASS FILTERED WHITE NOISE 


Consider next a white-noise process W(t) of zero mean and power spectral 
density N,/2 applied to a low-pass filter, as in Fig. 4.14a. The transfer 
function of the filter is 


1 


A ee j2nfRC 


(4.97) 


The power spectral density of the noise N(t) appearing at the low-pass RC 
filter output is therefore (see Fig. 4.14b) 


H = No/2 
Sw) = TF DARCY (nf RC) (4.98) 
From Example 4 of Chapter 2, we have 
exp (=l) = —— (4.99) 
x ——~ 1 + (2nfy 


Therefore, using the time-scaling property of the Fourier transform, we 


Figure 4.14 
Characteristics of RC-filtered white noise. (a) Low-pass RC filter. (b) Power spectral 
density of filter output N(t). (c) Autocorrelation function of Nit). 
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-461RC -2RC-RC 9 RC2RC 4.61RC ; 


(c) 
Figure 4.14 (continued) 


Seeoesececvecessesosscveccesoences 


find that the autocorrelation function of the filtered noise process N(t) is 


N 
ROE ae exp( - £L) (4.100) 


which is plotted in Fig. 4.14c. 
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EXAMPLE 10 AUTOCORRELATION OF A SINUSOIDAL WAVE PLUS 
WHITE NOISE 


Consider a random process X(t) consisting of a sinusoidal wave component 
and a white-noise process of zero mean and power spectral density No/2. 
A sample function (i.e., single realization) of X(t) is denoted by 


x(t) = A cos(2nf.t + 0) + w(t) (4.101) 


The phase @ of the sinusoidal component may lie anywhere inside the 
interval -z < 0 < z with equal likelihood. The problem is to determine 
the autocorrelation function of the random process X(t) represented by 
the sample function x(t). 

The two components of x(t) originate from independent sources. There- 
fore, the autocorrelation function of X(t) is the sum of the individual 
autocorrelation functions of the sinusoidal wave and white-noise compo- 
nents. In Example 6, we showed that the autocorrelation function of the 
sinusoidal component is equal to (A?/2) cos(2zf,t). The autocorrelation 
function of the white-noise component is equal to (N,/2)d(t). We may 
therefore write 


R,x(t) = cos(2zf,t) + * 6(t) (4.102) 


which is plotted in Fig. 4.15. We thus see that for |t| > 0, the autocorrelation 
function of the random process X(t) is the same as that of the sinusoidal 
wave component. This shows that by determining the autocorrelation func- 
tion of X(t) we can detect the presence of a periodic signal component 
that is corrupted by additive white noise. 


Figure 4.15 ; 
Autocorrelation function of sinusoidal wave plus white noise. 
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4.8 NOISE-EQUIVALENT BANDWIDTH 


In Example 8 we observed that when a source of white noise of zero mean 
and power spectral density Nj/2 is connected across the input of an ideal 
low-pass filter of bandwidth B and passband amplitude response of one, 
the average output noise power [or equivalently Ry(0)] is equal to NOB. 
In Example 10 we observed that when such a similar noise source is 
connected to the input of the simple RC low-pass filter of Fig. 4.144, 
the corresponding value of the average Output noise power is equal to 
N./(4RC). For this filter, the half-power or 3-dB bandwidth is equal to 
1/(2xRC). We may therefore make two important observations. First, 
filtered white noise has finite average power. Second, the average power 
is proportional to bandwidth. 

We may generalize these observations to include all kinds of low-pass 
filters by defining a noise-equivalent bandwidth as follows. Suppose that 
we have a source of white noise of zero mean and power spectral density 
N,/2 connected to the input of an arbitrary low-pass filter of transfer func- 
tion H(f). The resulting average output noise power is therefore 


No f” 
PD Nes 


N, | “AAR af (4.103) 


Py |H(f)? df 


where, in the last line, we have made use of the fact that the amplitude 
response |H(f)| is an even function of frequency. Consider next the same 
source of white noise connected to the input of an ideal low-pass filter of 
zero-frequency response H(0) and bandwidth By. In this case, the average 
output noise power is 


Equation 4.104 shows that the filtered noise power Py is finite and pro- 
portional to bandwidth By. The bandwidth By is called the noise-equivalent 
bandwidth for a low-pass filter; its definition follows directly from Eqs. 
4.103 and 4.104 as 


f HOP af 


OY a 


(4.105) 


Thus the procedure for calculating the noise-equivalent bandwidth consists 
of replacing the arbitrary low-pass filter of transfer function H (f) by an 
equivalent ideal low-pass filter of zero-frequency response H (0) and band- 
width By, as illustrated in Fig. 4.16. 


NOISE-EQUIVALENT BANDWIDTH 167 


IH (f) |? 


Figure 4.16 
The definition of noise-equivalent bandwidth for low-pass filter. 


In a similar way, we may define a noise-equivalent bandwidth for a 
band-pass filter, as illustrated in Fig. 4.17; this figure depicts the squared 
amplitude response of the filter for positive frequencies only. Thus, the 
noise-equivalent bandwidth for a band-pass filter may be defined as 


[acne ar 


Bu = TP 


(4.106) 


where |H(f,)| is the center-frequency amplitude response of the filter. 
We may combine the definitions of Eqs. 4.105 and 4.106 for the noise- 


|H(f)|? 


[Hf 


Figure 4.17 
The definition of noise equivalent bandwidth for band-pass filters; only the 


response for positive frequencies is shown. 
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equivalent bandwidth of low-pass and band-pass filters into a single for- 
mula: 


ee = [op af (4.107) 


where |H(f)| is the amplitude response of the filter. The parameter g, in 
Eq. 4.107 is the maximum available power gain of the filter, defined by 


. &a = Maximum value of |H(f)|? 
|H (0), low-pass ‘filter 
|H(f.)?, band-pass filter 


(4.108) 


Correspondingly, we may express the output noise power of a filter (for 
both positive and negative frequencies) as 


Py = Noga By (4.109) 


where N,/2 is the noise power spectral density at the filter input. According 
to Eq. 4.109, the effect of passing white noise through a filter may be 
separated into two parts: 


1. The maximum available power gain of the filter, g,. 


2. The noise-equivalent bandwidth By, representing relative frequency se- 
lectivity of the filter. 


Eq. 4.109 also shows that, whether the filter of interest is low-pass or band- 
pass, the filtered noise power Py is Proportional to the noise-equivalent 
bandwidth By. Hence, as a general rule, we may state that the effect of 
noise in a system (e.g., communication receiver) is reduced by narrowing 
the system bandwidth. 


EXERCISE 18 What is the noise- 


_ EXERCISE18 Wh: uivalent bi -pass 
filter of Fig. 4.14a? Express your answer in te 


dwidth — 


of the filter. 


PSION OORT” weees ees ennseeseessssesaedanisdiskeisavesesscaauivedescessdvesdasedtoeetememttoness tc en T 


PROBLEMS 
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P4.1 Energy Spectral Density 


Problem 1 Consider the decaying exponential pulse 


exp(—at), t>0 


7? a 
0, t<0 


g(t) = 
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Find the percentage of the total energy of g(t) contained inside the fre- 
quency band —W < f < W, where W = a/2z. 


Problem 2 Show that the two different pulses defined in parts a and b 
of Fig. P4.1 have the same energy spectral density: 


_ 4A°T’ cos(nTf) 
wolf) = CCU eal)? 


(a) (b) 


Figure P4.1 


P4.2 Correlation of Energy Signals 


Problem 3 Determine and sketch the autocorrelation functions of the 
following exponential pulses: 


(a) g(t) = exp(-at)u(t) 
(b) g(t) = exp(—altl) 
(c) g(t) = exp(—at)u(t) — exp(at)u(—t) 


where u(t) is the unit step function, and u(—f) is its time-reversed 
version. 


Problem 4 Determine and sketch the autocorrelation function of a Gaus- 
sian pulse defined by 


1 mt? 
g(t) = 7 exp( -26 
0 0 


Problem5 The Fourier transform of a signal is defined by |sinc(f)|. Show 
that the autocorrelation function of this signal is triangular in form. 


Problem 6 Specify two distinctly different pulse signals that have exactly 
the same autocorrelation function. 


Problem 7 Consider a signal g(t) defined by 


g(t) = Ao + A, cos(2zf it + 6) + A, cos(2r fat + 02) 
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Figure P4.2 


(a) Determine the autocorrelation function R,(t) of this signal. 

(b) What is the value of R,(0)? 

(c) Has any information about g(t) been lost in obtaining the autocor- 
relation function? 


Problem 8 Determine the autocorrelation function of the triplet pulse 
shown in Fig. P4.2 


Problem9 Let G(f) denote the Fourier transform of a real-valued energy 
signal g(t), and R,(t) its autocorrelation function. Show that 


I. =a = 4n? |" PIGG af 


Problem 10 Determine the cross-correlation function R(T) of the pair 
of rectangular pulses shown in Fig. P4.3, and sketch it. What is R(t)? 


Problem 11 Determine the cross-correlation function R(T) of the rect- 
angular pulse g,(t) and triplet pulse g,(t) shown in Fig. P4.4, and sketch 
it. What is R2(t)? Are these signals orthogonal? Why? 


gilt) 82(t) 


-2T 0 2T 


TES) 
© 


Figure P4.3 
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Figure P4.4 


Problem 12 Consider two signals g,(t) and g(t). These two signals are 
delayed by amounts equal to ¢, and t, seconds, respectively. Show that the 
time delays are additive in convolving the pair of delayed signals, whereas 
they are subtractive in cross-correlating them. 


P4.3 Power Spectral Density 
Problem 13 Consider the truncated version of a complex exponential, 
defined by 
t 
gr(t) = A exp(j2zf.t) rea(;5) 


where rect(t/27) is a rectangular function of unit amplitude and duration 
2T. Find the power spectral density of g(t) for finite T. What is the limiting 
value of this power spectral density as T approaches infinity? 


Problem 14: Figure P4.5 shows the power spectral density of a power 


signal g(t). Find the average power of the signal. 


Solf) 


Figure P4.5 
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Sff) 


1.0 


Figure P4.6 


P4.4 Correlation of Power Signals 


Problem 15 Find the autocorrelation function of the truncated version 
of a complex exponential, defined in Problem 13. What is the limiting value 
of this autocorrelation as T approaches infinity? 


Problem 16 Find the autocorrelation function of a power signal g(t) 
whose power spectral density is depicted in Fig. P4.6. What is the value 
of this autocorrelation function at the origin? 


P4.6 Spectral Characteristics of Periodic Signals 


Problem 17 Consider the square wave shown in Fig. P4.7. Find the power 
spectral density, average power, and autocorrelation function of this square 
wave. Does the wave have dc power? Explain your answer. 


Problem 18 Consider two periodic signals 8>pi(t) and g,2(t) that have the 
following complex Fourier series representations: 


= j2nnt 
&pilt) = È Cin exp( -! T ) 


n=-@ 0 


&p(t) (volts) 


t (seconds) 


Figure P4.7 
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and 


ia i2nnt 
got) = È Con exp( -i T, ) 


n=—% 


The two signals have a common period equal to Tọ. 
Using the following definition of cross-correlation for a pair of periodic 
signals, 


1 ERE 
Ralt) = F |” EnO- 2) a 


show that the prescribed pair of periodic signals satisfies the Fourier trans- 
form pair 


= n 
R,(t) == » Cnn ali R z) 


n=-% 


P4.7 Spectral Characteristics of Random Signals and Noise 


Problem 19 The power spectral density of a random process X(t) is 
shown in Fig. P4.8. 


(a) What is the dc power contained in this random process? 
(b) What is the ac power contained in it? 


Figure P4.8 


Problem 20 A white noise process of zero mean and power spectral 
density N,/2 is applied to the low-pass RL filter shown in Fig. 4.9. Deter- 


Input R Output 


Figure P4.9 
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mine the power spectral density and autocorrelation function of the out- 
put. 


Problem 21 Consider a white-noise process of zero mean and power 
spectral density No/2 applied to the input of the system shown in Fig. 
P4.10. 


(a) Find the power spectral density of the random process at the output 
of the system. 
(b) What is the average power of this output? 


Hint: You may use Eq. 4.52, interpreted for a random process, to evaluate 
the power spectral density of the low-pass filter input. 


P4.8 Noise-Equivalent Bandwidth 


Problem 22 Find the noise-equivalent bandwidth for the low-pass RL 
filter shown in Fig. P4.9. 


Problem 23 A white-noise process of power spectral density No/2 is ap- 
plied to a Butterworth low-pass filter of order n with its amplitude response 


White 


Low-pass Output 
filter 


HA {f) 


Band-pass 
filter 


H, (f) 


cos (2rf,t) 


|H2(f)| 


cf 0) ie 0 


Figure P4.10 
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defined by 


1 
d 


(a) Determine the noise-equivalent bandwidth for this low-pass filter. 
(b) What is the limiting value of the noise-equivalent bandwidth as n 
approaches infinity? 
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CHAPTER FIVE 


DIGITAL CODING 
e VVAL -CJA IV 


T transport an information-bearing signal from one point to another 
over a communication channel, we may use digital or analog techniques. 
As mentioned in Chapter 1, the use of digital communications offers 
several important advantages as compared to analog communications. In 
particular, a digital communication system offers the following highly 
attractive features: 


1. Ruggedness to channel noise and external interference, unmatched by 
any analog communication system. 


2. Flexible operation of the system. 
. Integration of diverse sources of information into a common format. 


4. Security of information in the course of its transmission from source to 
destination: 


WwW 
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For these reasons, digital communications have become the dominant form 
of communication technology in our society. 

To handle the transmission of analog message signals (e.g., voice and 
video signals) by digital means, the signal has to undergo an analog-to- 
digital conversion. In the next section, we present an overview of three 
important methods of analog-to-digital conversion, which are known as 
pulse-code modulation, differential pulse-code modulation, and delta mod- 
ulation. Their detailed descriptions are presented in subsequent sections 
of the chapter. 


ooo cic 5.1 DIGITAL PULSE MODULATION 


The process of analog-to-digital conversion is sometimes referred to as 
digital pulse modulation. The use of the terminology “pulse modulation” 
is justified by virtue of the fact that the first operation performed in the 
conversion of an analog signal into digital form involves the representation 
of the signal by a sequence of uniformly spaced pulses, the amplitude of 
which is modulated by the signal. Naturally, the pulse-repetition frequency 
must be chosen in accordance with the sampling theorem. In both pulse- 
code modulation and differential pulse-code modulation, the pulse-repe- 
tition frequency or the sampling rate is chosen to be slightly greater than 
the Nyquist rate (i.e., greater than twice the highest frequency component) 
of the analog signal. In delta modulation, on the other hand, the sampling 
rate is purposely chosen to be much greater than the Nyquist rate. The 
reason for such a choice in the latter case is to increase correlation between 
adjacent samples derived from the information-bearing analog signal and 
thereby to simplify the physical implementation of the delta modulation 
process. The distinguishing feature between pulse-code modulation and 
differential pulse-code modulation is that in the latter case, additional 
circuitry (designed to perform linear prediction) is used to exploit the 
correlation between adjacent samples of the analog signal so as to reduce 
the transmitted bit rate. 

Figure 5.1 summarizes the comparison between delta modulation, pulse- 
code modulation, and differential pulse-code modulation in the context of 
two important system features: circuit complexity and transmitted bit rate. 
The bit rate refers to the rate at which bits (binary digits) constituting the 
digital version of an analog information-bearing signal are transmitted over 
the communication channel. 

Pulse-code modulation is usually viewed as a benchmark against which 
other methods of digital pulse modulation are measured in performance 
and circuit complexity. It is therefore appropriate that we begin our study 
of digital pulse modulation by considering the operations involved in pulse- 
code modulation, which we do in the next section. 
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Delta 
modulation 


Simplified 
Pulse-code cireunt Reese 
modulation implementation ar 


Differential 


pulse-code 
modulation 


Figure 5.1 
Diagrammatic comparison of the three basic forms of digital pulse modulation. 


osoo 5.2 PULSE-CODE MODULATION 


Pulse-code modulation! (PCM) is complex in the sense that the message 
signal is subjected to a great number of operations. The essential operations 
in the transmitter of a PCM system are sampling, quantizing, and encoding, 
as shown in Fig. 5.2. The quantizing and encoding operations are usually 
performed in the.same circuit, which is called an analog-to-digital converter. 
The essential operations in the receiver are regeneration of impaired signals, 
decoding, and demodulation of the train of quantized samples. These op- 
erations are usually performed in the same circuit, which is called a digital- 
to-analog converter. At intermediate points along the transmission route 
from the transmitter to the receiver, regenerative repeaters are used to 
reconstruct (regenerate) the transmitted sequence of coded pulses in order 
to combat the accumulated effects of signal distortion and noise. 

Quantizing refers to the use of a finite set of amplitude levels and the 
selection of a level nearest to a particular sample value of the message 
signal as the representation for it. This operation, combined with sampling, 
permits the use of coded pulses for representing the message signal. Indeed, 
it is the combined use of quantizing and coding that distinguishes pulse- 
code modulation from analog modulation techniques. 

In the next three sections, we discuss the operations of sampling, quan- 
tizing, and coding, in that order. 


1Pulse-code modulation is the oldest method for analog-to-digital conversion. It was 
invented by Reeves in 1937. For a historical account of this invention, see Reeves 
(1975). 
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PCM 


Continuous— Low-pass Sampler Quantizer 
time message filter wave 
signal 
Transmitter 
(a) 
Distorted ; Š Regenerated 
PCM Regenerative | y Regenerative PCM 


repeater repeater 


wave wave 


Transmission path 


(b) 


Reconstruction 
filter 


Regeneration 
circuit 


Input Decoder Destination 


Receiver 
(c) 
Figure 5.2 
The basic elements of a PCM system. (a) Transmitter. (b) Transmission path. 
(c) Receiver. 
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The sampling operation is performed in accordance with the sampling 
theorem. Specifically, we may state the sampling theorem for band-limited 
signals of finite energy in two equivalent parts (see Section 2.7): 


1. A band-limited signal of finite energy, which has no frequency compo- 
nents higher than W hertz, is completely described by specifying the values 
of the signal at instants of time separated by 1/2W seconds. 

2. A band-limited signal of finite energy, which has no frequency compo- 
nents higher than W hertz, may be completely recovered from a knowl- 
edge of its samples taken at the rate of 2W per second. 


Part 1 of the sampling theorem is exploited in the transmitter; part 2 of 
the theorem is exploited in the receiver. The sampling rate 2W is called 
the Nyquist rate, and its reciprocal 1/2W is called the Nyquist interval. 
The derivation of the sampling theorem, presented in Section 2.7, was 
based on the assumption that the message signal of interest is strictly band- 
limited. In practice, however, the amplitude spectrum of the signal ap- 
proaches zero asymptotically as the frequency approaches infinity, as il- 
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lustrated in Fig. 5.3a. This factor gives rise to an effect called aliasing or 
fold-over, which refers to a high-frequency component in the spectrum of 
the message signal apparently taking on the identity of a lower frequency 
in the spectrum of a sampled version of the signal. 

The aliasing effect is illustrated in Fig. 5.35. This figure shows the mes- 
sage spectrum and two frequency-shifted replicas of it; one replica is shifted 
to the right by the sampling rate f, = 2W, and the other replica is shifted 
to the left by f,. These replicas are manifestations of the periodic spectrum 
that results from sampling the message signal at the rate f,; see Section 
2.7. Inspection of the spectrum of the sampled signal, which is the sum of 
the message spectrum and its frequency-shifted replicas, shows that we are 
no longer able to recover the original message spectrum without distortion, 
owing to the presence of aliasing. 

The presence of aliasing results in signal distortion. To combat the effects 
of aliasing in practice, we use two corrective measures: 


1. Prior to sampling, a low-pass pre-alias filter is used to attenuate those 
high-frequency components of the signal that lie outside the band of 
interest. 


2. The filtered signal is sampled at a rate higher than the Nyquist rate. 


Figure 5.4 is the block diagram of a system for performing the sampling 
process. The low-pass pre-alias filter is included at the input of the sampling 
system, in accordance with point 1. The sampling rate is determined in 
accordance with point 2 by setting the pulse repetition frequency f, of the 
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Spectrum of 
sampled signal 
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message spectrum Replica of message 


spectrum shifted 
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Pad pi f 


Figure 5.3 l 
The aliasing effect. (a) Message spectrum. (b) Spectrum of sampled signal. 
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Figure 5.4 
Practical sampling circuit arrangement. 


timing pulse generator at a value greater than the Nyquist rate 2W, where 
W is the pre-alias filter bandwidth. 


SAMPLE-AND-HOLD CIRCUIT 


The generation of samples is actually performed by a functional block 
termed the sample-and-hold circuit in Fig. 5.4. This circuit produces flat- 
top samples rather than the idealized instantaneous samples as postulated 
by the sampling theorem. Basically, the sample-and-hold circuit consists 
of two field-effect transistor (FET) switches and a capacitor connected 
together as in Fig. 5.5a. The “sampling switch” is closed briefly by a short 
pulse applied to gate G; of one transistor. The capacitor is thereby quickly 
charged up to a voltage equal to the instantaneous sample value of the 
incoming signal. It holds the sampled voltage until discharged by a pulse 
applied to gate G, of the other transistor. The output of the sample-and- 
hold circuit thus consists of a sequence of flat-top samples, as depicted in 
Fig. 5.5. 


PULSE-AMPLITUDE MODULATION 


The sequence of flat-top samples depicted as s(t) in Fig. 5.55 represents 
a pulse-amplitude modulated wave. In pulse-amplitude modulation (PAM), 
the amplitudes of regularly spaced rectangular pulses vary with the instan- 
taneous sample values of an analog message signal in a one-to-one fashion.* 


7Pulse-amplitude modulation is one basic type of analog pulse modulation. There 
are two other basic types of analog pulse modulation: pulse-duration modulation 
and pulse-position modulation. In pulse-duration modulation (PDM), the samples of 
the message signal are used to vary the duration of the individual rectangular 
pulses. This form of modulation is also referred to as pulse-width modulation or 
pulse-length modulation. In pu/se-position modulation (PPM) the position of a 
pulse relative to its unmodulated time of occurrence is varied in accordance with 
the message signal. For a detailed discussion of analog pulse modulation 
techniques, see Carlson (1986, Chapter 10) or Black (1953). 
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Sampling 
switch 


Discharging 
switch 


Figure 5.5 
(a) Sample-and-hold circuit. (b) Flat-top samples. 


The waveform denoted by s(t) in Fig. 5.5b befits this definition exactly. 
Note that in PAM the carrier wave consists of a periodic train of rectangular 
pulses, and the carrier frequency (i.e., the pulse repetition frequency) is 
the same as the sampling rate. 

For a mathematical representation of the PAM wave s(t), we may write 


s(t) = 5 g(nZ)he - nT) 65.1) 


n=-0 


The term h(t) is a rectangular pulse of unit amplitude and duration T, 
defined as follows (see Fig. 5.6a) 


1 0<t<T 
h(t) = 43, t=0,t=T (5.2) 
0, otherwise 
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The term g(nT,) is the value of the input signal g(t) at time t = nT,. The 
instantaneously sampled version of the signal g(t) is given by 


git) = SD g(n o (5.3) 


n=-@ 


Convolving g,(t) with the pulse h(t), we get 


galt) BH he) = | shl- 2) de 


f È alaryoe - ntyne = 2) ae 


I 


> g(nT,) E dtr nel — 2) dr 


n=-% 


Using the sifting property of the delta function, we thus obtain 
gD TAO = E g(nT,)ae - nT,) (5.4) 


Therefore, from Eqs. 5.1 and 5.4 it followssthat s(t) is mathematically 
equivalent to the convolution of g,(t), the instantaneously sampled version 
of g(t), and the pulse A(t), as shown by 


s(t) = galt) I h(t) (5.5) 


Taking the Fourier transform of both sides of Eq. 5.5 and recognizing 
that the convolution of two time functions is transformed into the multi- 
plication of their respective Fourier transforms, we get 


SCF) = Gi F)H(F) (5.6) 


where S(f) = F[s(t)], G;(f) = F[g,;(t)], and H(f) = F[A(t)]. In Section 
2.7 we showed that instantaneous sampling of the time function g(t) in- 
troduces periodicity into the spectrum, as described in Eq. 2.131. This 
equation is reproduced here in the form 


Gf) =f. È G(f - mf,) (5.7) 
where f, = 1/T, is the sampling rate. Therefore, substitution of gs: 7 
into 5.6 yields 


S(f) =f. È OG- mfG) (5.8) 


where G(f) = F[g(t)]. 
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h(t) 
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T 
=E 2. asi 0 1 z B f 
T T T T T 


Figure 5.6 
(a) Rectangular pulse h(t). (b) Spectrum H(f). 


Finally, suppose that g(t) is strictly band-limited and that the sampling 
rate f, is greater than the Nyquist rate. Then, passing s(t) through a low- 
pass reconstruction filter, we find that the spectrum of the resulting filter 
output is equal to G(f)H(f). This is equivalent to passing the original 
analog signal g(t) through a low-pass filter of transfer function H( f ). 

From Eq. 5.2 we find that 


H(f) = T sine( fT) exp(—jxfT) (5.9) 


which is plotted in Fig. 5.66. Hence, we see that by using pulse-amplitude 
modulation to represent an analog message signal we introduce amplitude 
distortion as well as a delay of T/2. This effect is similar to that caused by 
the finite size of the scanning aperture in television and facsimile. Ac- 


e 
e 
b 


_ as the pulse duration T approaches zero? 
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Figure 5.7 
Block diagram of reconstruction circuit. 


cordingly, the distortion caused by the use of flat-top samples in the gen- 
eration of a PAM wave, as in Fig. 5.5b, is referred to as the aperture effect. 


EXERCISE 1 What happens to the transfer function H( f)/T of Eq. 5.9 


RECONSTRUCTION 


Since sampling of the incoming message signal is the first basic operation 
performed in a PCM transmitter, reconstruction of the message signal is 
the final operation performed in the PCM receiver. Figure 5.7 is a block 
diagram of the circuitry used to perform this reconstruction. It consists of 
two components connected in cascade. The first component is a low-pass 
interpolation filter with a bandwidth that equals the message bandwidth W. 
The second component is an equalizer that corrects for the aperture effect 
due to flat-top sampling in the sample-and-hold circuit. The equalizer has 
the effect of decreasing the in-band loss of the interpolation filter as the 
frequency increases in such a manner as to compensate for the aperture 
effect. Ideally, the amplitude response of the equalizer is given by 


pot ms E 
|H(f)|  Tsinc( fT) T sin(afT) 


where H(f) is the transfer function defined in Eq. 5.9. The amount of 
equalization needed in practice is usually small. 


EXAMPLE 1 


At f = f,/2, which corresponds to the highest frequency component of 
the message signal for a sampling rate equal to the Nyquist rate, we find 
from Eq. 5.9 that the amplitude response of the equalizer normalized to 
that at zero frequency is equal to 


1 GT) 
sinc(0.5T/T,)  sin[(z2/2)T/T,)] 


eco 
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ers 
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sinc (0.57/T,) 
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Duty cycle T/T, 
Figure 5.8 


Normalized equalization (to compensate for aperture effect) plotted versus T/T,. 


where the ratio T/T, is equal to the duty cycle of the sampling pulses. In 
Fig. 5.8 this result is plotted as a function of T/T,. Ideally, it should be 
equal to 1 for all values of T/T,. For a duty cycle of 10%, it is equal to 
1.0041. It follows therefore that for duty cycles of less than 10% the ap- 
erture effect becomes negligible. 
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.5.4 QUANTIZING 


A continuous signal, such as voice, has a continuous range of amplitudes 
and therefore its samples have a continuous amplitude range. In other 
words, within the finite amplitude range of the signal we find an infinite 
number of amplitude levels. It is not necessary in fact to transmit the exact 
amplitudes of the samples. Any human sense (the ear or the eye), as 
ultimate receiver, can only detect finite intensity differences. This means 
that the original continuous signal may be approximated by a signal con- 
structed of discrete amplitudes selected on a minimum error basis from an 
available set. The existence of a finite number of discrete amplitude levels 
is a basic condition of PCM. Clearly, if we assign the discrete amplitude 
levels with sufficiently close spacing, we may make the approximated signal 
practically indistinguishable from the original continuous signal. 

The conversion of an analog (continuous) sample of the signal into a 
digital (discrete) form is called the quantizing process. Graphically, the 
quantizing process means that a straight line representing the relation be- 
tween the input and output of a linear continuous system is replaced by a 
staircase characteristic, as in Fig. 5.9a. The difference between two adjacent 
discrete values is called a quantum or step size. Signals applied to a quan- 
tizer, with the input-output characteristic of Fig. 5.9a, are sorted into 
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Figure 5.9 

The quantizing principle. (a) Quantizing characteristic. (b) Characteristic of errors in 
quantizing. (c) A quantized signal wave and the corresponding error curve. This 
figure is adapted from Bennett (1948) by permission of AT and T. 
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amplitude slices (the treads of the staircase), and all input signals within 
plus or minus half a quantum step of the midvalue of a slice are replaced 
in the output by the midvalue in question. 

The quantizing error consists of the difference between the input and 
output signals of the quantizer. It is apparent that the maximum instan- 
taneous value of this error is half of one quantum step, and the total range 
of variation is from minus half a step to plus half a step. In part b of Fig. 
5.9 the error is shown plotted as a function of the input signal. In part c 
of the figure typical variations of the quantizer input, the quantizer output, 
and the difference between them (i.e., the quantizing error) as functions 
of time are indicated. 

A quantizer having the input-output amplitude characteristic of Fig. 
5.9a is said to be of the midtread type, because the origin lies in the middle 
of a tread of the staircase-like graph. According to this characteristic, the 
quantizer output may be expressed as id, where i = 0, +1, =2,..., +K. 
These discrete amplitude values of the quantizer output are called repre- 
sentation levels. A quantizer of the midtread type has an odd number of 
representation levels, as shown by 


jopeeyyc Fe (5.10) 


The dynamic range or peak-to-peak excursion of the quantizer input is LA. 
One half of this excursion defines the absolute value of the overload level 
of the quantizer. Clearly, the amplitude of the quantizer input must not 
exceed the overload level; otherwise, overload distortion results. 

In the quantizer example illustrated in Fig. 5.9a, the step size 4 equals 
1; the integer K is 6; and the number of representation levels L is 13. The 
corresponding absolute value of the overload level is 13/2. 


QUANTIZING NOISE 


Quantizing noise or quantizing error is produced in the transmitting end 
of a PCM system by rounding off the sampled values of a continuous message 
signal to the nearest representation level. We assume a quantizing process 
with a uniform step size denoted by 4 volts, so that the representation 
levels are at 0, +4, +24, +34, . . . . Consider a particular sample at the 
quantizer input, with an amplitude that lies in the range i4 — (4/2) to 
id + (4/2), where i is an integer (positive or negative, including zero) 
and i4 defines the corresponding quantizer output. We thus have a region 
of uncertainty of width 4, centered about i4, as illustrated in Fig. 5.10. 
Let qe denote the value of the error produced by the quantizing process. 
Then the amplitude of the sample at the quantizer input is i4 + qe. It is 
apparent that with a random input signal, the quantizing error q, varies 
randomly within the interval — 4/2 < qe S 4/2. 

When the quantization is fine enough (say, the number of representation 
levels is greater than 64), the distortion produced by quantizing noise affects 
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Figure 5.10 
Illustrating the quantizing error Ge- 


the performance of a PCM system as though it were an additive indepen- 
dent source of noise with zero mean and mean-square value determined 
by the quantizer step size 4. The reason for this is that the power spectral 
density of the quantizing noise in the quantizer output is practically in- 
dependent of that of the message signal over a wide range of input signal 
amplitudes. Furthermore, for a message signal of a root mean-square value 
that is large compared to a quantum step, it is found that the power spectral 
density of the quantizing noise has a large bandwidth compared with the 
signal bandwidth. Thus, with the quantizing noise uniformly distributed 
throughout the signal band, its interfering effect on a signal is similar to 
that of thermal noise. (Thermal noise is discussed in Appendix C.) 

We say that the quantizing noise is uniformly distributed when the error 
may take on a sample value q, anywhere inside the interval (— 4/2, 412) 
with equal likelihood. Under this assumption, we may determine the avy- 
erage power of the quantizing noise by averaging q, the squared quantizing 
error, over all possible values of g,. We may thus express the average 
power of quantizing noise, P,, as follows 


na P qi dq. 
= — (5.11) 


Thus, the average power of quantizing noise grows as the square of the 
step size 4. This is perhaps the most often used result in quantization. 


eee 
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The step size 4 is under the designer’s control. Hence, the signal dis- 
tortion due to quantizing noise can be controlled by choosing the step size 
A small enough, as illustrated in the following example. 
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EXAMPLE 2 SIGNAL-TO-QUANTIZING NOISE RATIO FOR 
SINUSOIDAL MODULATION 


Consider the special case of a full-load sinusoidal modulating wave of 
amplitude A,,, which uses all the representation levels provided. The av- 
erage signal power is A?,/2. The peak-to-peak excursion of the quantizer 
input is 2A,,, because the modulating wave swings between —A,, and Ap. 
Assuming that the number of representation levels equals L, the quantizer 
step size is 


A = (5.12) 


Therefore Eq. 5.11 gives the average quantizing noise power as 


Ain 
P, = 3? (9.413) 
Thus the output signal-to-quantizing noise ratio of the PCM system, for a 
full-load test tone, is 
Az,/2 3: 


(SNR) = AZIL? Po (5.14) 


Expressing the signal-to-quantizing noise ratio in decibels, we get 
10 logig(SNR)y = 1.8 + 20 logioL (5.15) 
Hence, the output signal-to-noise ratio of a PCM system in decibels, due 


to quantizing noise, increases logarithmically with the number of repre- 
sentation levels, L. 


TABLE 5.1 
Number of Code Word 
Representation Levels, Length Signal-to-Quantizing 
L on Noise Ratio, dB 
a2 5 31.8 
64 6 37.8 
128 7 43.8 
256 8 49.8 
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For various values of L, the corresponding values of signal-to-quantizing 
noise ratio are as given in Table 5.1. The second column of this table 
corresponds to the binary code word length, an issue that is considered in 
Section 5.5. 


EXERCISE 2 A sinusoidal signal is transmitted using PCM. The output 
signal-to-quantizing noise ratio is required to be 55.8 dB. Find the minimum 
number of representation levels L required to achieve this performance. 


COMPANDING 


The quantizing process based on Fig. 5.9a uses a uniform separation be- 
tween the representation levels. In certain applications, however, it is 
preferable to use a variable separation between the representation levels. 
For example, the ratio of voltage levels covered by voice signals, from the 
peaks of loud talk to the weak passages of weak talk, is on the order of 
1000 to 1. The excursions of the voice signal into the large amplitude ranges, 
which occur in practice relatively infrequently, can be taken care of by 
using a nonuniform quantizer. Such a quantizer is designed so that the step 
size increases as the separation from the origin of the input-output ampli- 
tude characteristic is increased. We thus find that the weak passages, which 
need more protection, are favored at the expense of the loud passages. In 
this way, a nearly uniform percentage precision is achieved throughout the 
amplitude range of the input signal, with the result that fewer steps are 
needed than would be the case if a uniform quantizer were used. 

The use of a nonuniform quantizer is equivalent to passing the baseband 
signal through a compressor and then applying the compressed signal to a 
uniform quantizer. A particular form of compression law that is used in 
practice is the so-called y-law defined by 


log(1 + ylv,)) 
v| = —=— : 
where v; and v, are normalized input and output voltages, and y is a positive 
constant. Figure 5.11a plots the y-law for varying u. The case of uniform 
quantization corresponds to u = 0. Fora given value of yu, the reciprocal 
slope of the compression curve, which defines the quantum steps, is 


dlv,| _ log(1 + u) 
d|v,| H 


Oel (517) 


We see therefore that the y-law is neither strictly linear nor strictly loga- 
rithmic, but it is approximately linear at low input levels corresponding to 
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Figure 5.11 
Compression laws. (a) w-law. (b) A-law. 


u\v,| < 1, and approximately logarithmic at high input levels corresponding 
to y|v,| > 1. 

Another compression law that is used in practice is the so-called A-law 
defined by 


Alv,| 1 
1 + loga e. 
1 + log(Alv,|) a lu 1 

1 + logA 


which is shown plotted in Fig. 5.11b. Practical values of A (as of u in the 
L-law) tend to be in the vicinity of 100. The case of uniform quantization 
corresponds to A = 1. The reciprocal slope of this compression curve is 


1 + logA 
d|v,| A 


d\o,| (1 + logA)|v,| 


(5.19) 


0 < |u| < 
1 
— < 


<|v,| < 


A 


Thus the quantum steps over the central linear segment, which have 
a dominant effect on small signals, are diminished by the factor 
A/(1 + logA). This is typically about 25 dB in practice, as compared with 
uniform quantization. 

To restore the signal samples to their correct relative levels, we must, 
of course, use a device in the receiver with a characteristic complementary 
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to the compressor. Such a device is called an expander. Ideally, the 
compression and expansion laws are exactly inverse so that, except for the 
effect of quantization, the expander output is equal to the compressor input. 
The combination of a compressor and an expander is called a compander. 

In actual PCM systems, the companding circuitry does not produce an 
exact replica of the nonlinear compression curves shown in Fig. 5.11. Rather, 
it provides a piecewise linear approximation to the desired curve. By using 
a large enough number of linear segments, the approximation can approach 
the true compression curve very closely. This form of approximation is 
illustrated in Section 5.11. 


5.5 CODING 


In combining the processes of sampling and quantizing, the specification 
of a continuous message signal becomes limited to a discrete sequence of 
values, but not in the form best suited to transmission over a line or radio 
path. To fully exploit the advantages of sampling and quantizing, we require 
the use of an encoding process to translate the discrete sequence of sample 
values to a more appropriate form of signal. Any plan for representing 
each element of this discrete set of values as a particular arrangement of 
discrete events is called a code. One of the discrete events in a code is 
called a code element or symbol. For example, the presence or absence of 


TABLE 5.2 
Ordinal Number of Level Number Expressed 
Representation Level as Sum of Powers of 2 Binary Number 
0 0000 
1 ZZ 0001 
2 2 0010 
3 2! +(20 0011 
4 Ue 0100 
5 a ar 2M onor 
6 PES ta: 0110 
7 2 2 0111 
8 27 1000 
9 2 a2" 1001 
10 23 ae 1010 
11 2 ar 2 aP ee 1011 
12 2 1100 
13 pe ie Pee ae fe 1101 
14 2 2 H? ilies 
15 2 oe Ps LILIS 


ess 
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a pulse is a symbol. A particular arrangement of symbols used in a code 
to represent a single value of the discrete set is called a code word or 
character. 

In a binary code, each symbol may be either of two distinct values or 
kinds, such as the presence or absence of a pulse. The two symbols of a 
binary code are customarily denoted as 0 and 1. In a ternary code, each 
symbol may be one of three distinct values or kinds, and so on for other 
codes. However, the maximum advantage over the effects of noise in a 
transmission medium is obtained by using a binary code, because a binary 
symbol withstands a relatively high level of noise and is easy to regenerate. 

Suppose that, in a binary code, each code word consists of n bits; the 
bit is an acronym for binary digit. Then, using such a code, we may rep- 
resent a total of 2” distinct numbers. For example, a sample quantized into 
one of 128 levels may be represented by a 7-bit code word. There are 
several ways of establishing a one-to-one correspondence between repre- 
sentation levels and code words. A convenient one is to express the ordinal 
number of the representation level as a binary number. In the binary 
number system, each digit has a place-value that is a power of 2, as illus- 
trated in Table 5.2 for the case of n = 4. 


Sea ceressececescscescccs00 COC OHESES SOHO SOOT OSES OS OEAO SOO SOSOO TTS OTHE SOOTO OOOO HOST RESOOSESSOROSSOSO0R eoooooooooooo esococooooo 
. 


EXAMPLE 3 SIGNAL-TO-QUANTIZING NOISE RATIO FOR SINUSOIDAL 
MODULATION (CONTINUED) 

In this example, we reformulate the output signal-to-quantizing noise ratio 
of Eq. 5.15 for a PCM system operating with a full-load test tone. This 
equation is reproduced here for convenience 


10 logio(SNR)o = 1.8 te 20 logioL, dB 


where L is the number of representation levels used in the system. As- 
suming the use of an n-bit binary code word, we may define L for a 
quantizer of the midtread type as 


L = w 
=2", n large (5.20) 


Accordingly, we may redefine the output signal-to-quantizing noise ratio 
in terms of the code word length n as 


For various values of n, the corresponding values of signal-to-quantizing 
noise ratio are as given in Table 5.1. The formula of Eq. 5.21 states that 
each bit in the code word of a PCM system contributes 6 dB to the output 
signal-to-quantizing noise ratio. 
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EXAMPLE 4 TRADEOFF BETWEEN CHANNEL BANDWIDTH AND 
SIGNAL-TO-QUANTIZING NOISE RATIO 


We may develop further insight into the performance of a PCM system by 
examining the relationship between the signal-to-quantizing noise ratio and 
transmission bandwidth requirement of a binary PCM system. For the 
purpose of this evaluation, we will again consider the use of a sinusoidal 
modulating wave. 

From our discussion of the sampling process, we have seen that a mes- 
sage signal of bandwidth W requires a minimum sampling rate of 2W. With 
each signal sample represented by an n-bit code word, the bit duration T, 
has a maximum value of 1/2nW. In Section 6.4, it is shown that the channel 
bandwidth B required to transmit a pulse of this duration is given by 


B = knW (5.22) 


where x is a constant with a value between 1 and 2. 
Expressing the output signal-to-quantizing noise ratio simply as a ratio, 
we have from Eqs. 5.14 and 5.20: 


3 
(SNR) = 5 (4") (523) 
Accordingly, using Eqs. 5.22 and 5.23, we get 
3 BikW 
(SNR) = 5 (4 ) (5.24) 


This relation shows that a PCM system is capable of improving the out- 
put signal-to-noise ratio exponentially with the bandwidth expansion ra- 
tio B/W. 
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_ EXERCISE 3 A television (TV) signal with a bandwidth of 4.2 MHz is 
_ transmitted using binary PCM. The number of representation levels is 512. 
_ Calculate the following parameters: : j 

(a) The code word length. 

(b) The final bit rate. | 

(c) The transmission bandwidth, assuming that x = 2 in Eq. 5.22. 


EXERCISE 4 The frequency content of a studio-quality audio signal that 
_ we like to hear extends from 20 Hz to 20 kHz. For professional use, the 
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DIGITAL FORMATS 


To send the encoded digital data over a channel, we require the use of a 
format or waveform for representing the data.? In this context, we have a 
number of formats available to us. Figure 5.12 illustrates some commonly 
used ones for the example of binary sequence 0110100011. Specifically, we 
have illustrated the following formats: 


(a) Symbol 1 is represented by transmitting a pulse of constant ampli- 
tude for the duration of the symbol, and symbol 0 is represented by 
switching off the pulse, as in Fig. 5.12a. This type of format is referred 
to as on-off or unipolar signaling. 
(b) Symbols 1 and 0 are represented by pulses of equal positive and 
negative amplitudes, as in Fig. 5.12b. This type of format is referred to 
as polar signaling. 
(c) A rectangular pulse (half-symbol wide) is used for a 1 and no pulse 
for a 0, as in Fig. 5.12c. This type of format is called return-to-zero (RZ) 
signaling. 
(d) Positive and negative pulses (of equal amplitude) are used alter- 
nately for symbol 1, and no pulse for symbol 0, as in Fig. 5.12d. This 
type of format is called bipolar signaling. A useful property of this 
method of signaling is that the power spectrum of the transmitted signal 
has no dc component and relatively insignificant low-frequency com- 
ponents. 
(e) Symbol 1 is represented by a positive pulse followed by a negative 
pulse, with both pulses being of equal amplitude and half-symbol wide; 
for symbol 0, the polarities of these pulses are reversed, as in Fig: 5.12e. 
This type of format is called a split-phase or Manchester code. It also 
suppresses the dc component and has relatively insignificant low-fre- 
quency components. 

Note that the polar signal waveform of Fig. 5.12b and the Manchester 
code of Fig. 5.12e are examples of nonreturn-to-zero (NRZ) signaling. 

The binary code is a special case of M-ary code. In practice, we usually 
find that M, the number of symbols in the code, is an integer power of 
2. Then, each code word in the M-ary code carries the equivalent in- 
formation of log,M bits. Consider, for example, a four-level (quarter- 
nary) code (i.e., M = 4). In such a code, we may identify four distinct 


3Digital formats (waveforms) are also referred to in the literature as line or 
transmission codes. 
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Figure 5.12 

Electrical representations of binary data. (a) On-off signaling. (b) Polar signaling. 
(c) Return-to-zero signaling. (d) Bipolar signaling. (e) Split-phase or Manchester 
code. (f) four-level Gray coding. 


dibits (pairs of bits). In Table 5.3a, we show two arrangements for the 
four possible dibits together with their individual electrical represen- 
tations. In particular, the dibits are shown in both their natural code 
and Gray code. Using the notations of the Gray code in Table 5.3a, the 
binary sequence 0110100011 is thus represented by the waveform shown 
in Fig. 5.12f. To obtain this waveform, the given sequence is viewed 
as a new sequence of dibits, namely, 01,10,10,00,11, and each dibit is 


represented in accordance with the Gray code of Table 5.3a. 
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TABLE 5.3 Examples of Natural and Gray Codes 
(a) Four-level code 


Code Word Electrical 
Number À Natural Code Gray Code Representation 

3) 

0 00 00 = 

2 

1 01 01 zA 

2 

1 

2 10 11 = 

as 2 

3 

3 11 10 fice 

2 

(b) Eight-level Code 

Code Word Electrical 
Number Natural Code Gray Code Representation 

0 000 000 zo 

2 

5 

1 001 001 = 

; 2 

3 

2 010 011 == 

2 

3 011 010 = 

2 

1 

4 100 110 aS 

2 

5 101 111 Ar 2 

2 

5 

6 110 101 += 

2 

7 

7 111 100 + 5 


The distinguishing feature of a Gray code‘ is that there is a one-bit 
change as we move from one code word to another. This is well illus- 
trated in the two Gray codes shown in Table 5.3 for M = 4,8. Note 
that in Table 5.3b for M = 8, for example, the rule of a one-bit change 
per transition applies not only to all the transitions for code word 0 to 


‘The origin of Gray codes goes back to the development of the rotary form of 
mechanical encoders known as shaft encoders. The use of Gray encoding makes it 
possible for electromechanical arrangements to change from one code word to 
another by changing the state of a single digit. With natural encoding, on the other 
hand, two or more digits may be required to change state simultaneously, which is 
difficult for electromechanical devices. 
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code word 1, from code word 1 to code word 2, and so on up to the 
transition from code word 6 to code word 7, but also to the “wrap- 
around” transition from code word 7 to code word 0. This wrap-around 
feature makes a Gray encoder cyclic in nature. 

The choice of a particular digital waveform is influenced by the ap- 
plication of interest. Nevertheless, it is highly desirable for a digital 
waveform to have the following properties: 


1. Timing content. The transmitted digital waveform should have ade- 
quate timing content to permit the extraction of clock information 
required for the purpose of synchronizing the receiver to the trans- 
mitter. 

2. Ruggedness. The waveform should possess immunity to channel noise 
and interference for prescribed channel bandwidth and transmitted 
power. 

3. Error detection capability. The waveform should permit the detection 
of errors that may occur in the course of transmission due to the 
presence of channel noise. j 

4. Matched power spectrum. The power spectral density of the trans- 
mitted digital waveform should match the frequency response of the 
channel as closely as possible so as to minimize signal distortion. 


5. Transparency. The correct transmission of digital data over a channel 
should be transparent to the pattern of 1’s and 0’s contained in the 
data. 


It is for these reasons that we find, for example, the bipolar format has 
become the standard for transmitting binary encoded PCM data over 
telephone channels. 


EXERCISE 5 Rank the six digital waveforms depicted in Fig. 5.12 in 


increasing order of transmission bandwidth requirement. _ 


DECODING 


The first operation in the receiver is to regenerate (i.e., reshape and clean 
up) the received pulses. These clean pulses are then regrouped into code 
words and decoded (i.e., mapped back) into a quantized PAM signal. The 
decoding process involves generating a pulse the amplitude of which is the 
linear sum of all the pulses in the code word, with each pulse weighted by 
its place-value (2°, 2!, 27, 23, . . .) in the code. 

It is noteworthy that every operation performed in the transmitter of a 
PCM system, except for the quantizing operation, is reversible. Specifically, 
the operations of sampling and encoding performed in the transmitter are 
reversed by performing decoding and interpolation (in that order) in the 


REGENERATION 201 


receiver. On the other hand, quantizing is an irreversible process that 
manifests itself by destroying information; once quantizing noise is intro- 
duced in the transmitter, there is nothing we can do in the receiver to make 
up for the loss of information thereby incurred. 


ssccscsccsceseeeed-O REGENERATION 


The most important feature of PCM systems lies in the ability to control 
the effects of distortion and noise produced by transmitting a PCM wave 
through a channel. This capability is accomplished by reconstructing the 
PCM wave by means of a chain of regenerative repeaters sufficiently close 
along the transmission route. As illustrated in Fig. 5.13, three basic func- 
tions are performed by a regenerative repeater: equalization, timing, and 
decision making. The equalizer shapes the received pulses so as to com- 
pensate for the effects of amplitude and phase distortions produced by the 
transmission characteristics of the channel. The timing circuitry provides 
a periodic pulse train, derived from the received pulses, for sampling the 
equalized pulses at the instants of time where the signal-to-noise ratio is 
a maximum. The decision device is enabled at the sampling times deter- 
mined by the timing circuitry. It makes its decision based on whether or 
not the amplitude of the quantized pulse plus noise exceeds a predeter- 
mined voltage level. Thus, for example, in a PCM system with on-off 
signaling, the repeater makes a decision in each bit interval as to whether 
or not a pulse is present. If the decision is “yes” a clean new pulse is 
transmitted to the next repeater. If, on the other hand, the decision is 
“no,” a clean base line is transmitted. In this way, the accumulation of 
distortion and noise in a repeater span is completely removed, provided 
that the disturbance is not too large to cause an error in the decision- 
making process. Ideally, except for delay, the regenerated signal is exactly 
the same as the signal originally transmitted. In practice, however, the 
regenerated signal departs from the original signal for two main reasons: 


1. The presence of transmission noise and interference causes the repeater 
to make wrong decisions occasionally, thereby introducing bit errors 
into the regenerated signal; we will have more to say on this issue in 


Chapter 10. 
Distorted if Decision- Regenerated 
Amplifier- ! 

PCM equalizer making PCM 

wave device wave 
Timing 
circuit 

Figure 5.13 


Block diagram of a regenerative repeater. 
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2. If the spacing between received pulses deviates from its assigned value, 
a jitter is introduced into the regenerated pulse position, thereby causing 
distortion. 


5.7 DIFFERENTIAL PULSE-CODE MODULATION 


When a voice or video signal is sampled at a rate slightly higher than the 
Nyquist rate, the resulting sampled signal is found to exhibit a high cor- 
relation between adjacent samples. The meaning of this high correlation 
is that, in an average sense, the signal does not change rapidly from one 
sample to the next. When these highly correlated samples are encoded, as 
in a standard PCM system, the resulting encoded signal contains redundant 
information. This means that symbols that are not absolutely essential to 
the transmission of information are generated as a result of the encoding 
process. By removing this redundancy before encoding, we obtain a more 
efficient coded signal. 

- Now, if we know a sufficient part of a redundant signal, we may infer 
the rest, or at least make the most probable estimate. In particular, if we 
know the past behavior of a signal up to a certain point in time, it is possible 
to make some inference about its future values; such a process is commonly 
called prediction. Suppose then a message signal m(t) is sampled at the 
rate 1/7, to produce a sequence of correlated samples T, seconds apart; 
which is denoted by {m(nT,)}. The fact that it is possible to predict future 
values of the signal m(t) provides motivation for the differential quantization 
scheme shown in Fig. 5.14a. In this scheme, the input to the quantizer is 


e(nT,) = m(nT,) — m(nT,) (5.25) 


which is the difference between the unquantized input sample m(nT,) and 
a prediction of it, denoted by #(nT,). This predicted value is produced by 
using a prediction filter with an input, as we will see, that consists of a 
quantized version of the message sample m(nT,). The difference signal 
e(nT,) is called a prediction error, since it is the amount by which the 
prediction filter fails to predict the input exactly. 

By encoding the quantizer output, as in Fig. 5.14a, we obtain a variation 
of PCM, known as differential pulse-code modulation (DPCM). It is this 
encoded signal that is used for transmission. 

The quantizer output may be represented as 


e,(nT,) = e(nT,) + g.(nT,) (5.26) 
where q,(nT,) is the quantizing error. According to Fig. 5.14a, the quan- 
tizer output e,(nT,) is added to the predicted value r(nT,) to produce the 


prediction-filter input 


m,(nT,) = m(nT,) + e,(nT,) ' G27) 
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DPCM system. (a) Transmitter. (b) Receiver. 


Substituting Eq. 5.26 in 5.27, we get 
m,(nT,) = m(nT,) + e(nT,) + q-(nT,) (5.28) 


However, from Eq. 5.25 we observe that m(nT,) plus e(nT,) is equal to 
the incoming message sample m(nT,). Therefore, we may rewrite Eq. 5.28 
as follows 


m,(nT,) = m(nT,) + q(nT,) (5.29) 


which represents a quantized version of m(nT,). That is, irrespective of 
the properties of the prediction filter, the quantized sample, m,(nT,), at 
the prediction filter input, differs from the sample m(nT,) of the original 
message signal m(t) by the quantizing error q,(n7,). Accordingly, if the 
prediction is good, the average power of the prediction error sequence 
{e(nT,)} will be smaller than that of the message sequence {m(nT,)}. Hence, 
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a quantizer with a given number of levels can be adjusted to produce a 
quantizing error sequence with a smaller average power than would be 
possible if the incoming message sequence were quantized directly as in a 
standard PCM system. 

The receiver for reconstructing the quantized version of the input is 
shown in Fig. 5.14b. It consists of a decoder to reconstruct the quantized 
error sequence. The quantized version of the original input is reconstructed 
from the decoder output using the same prediction filter as used in the 
transmitter of Fig. 5.14a. In the absence of transmission noise, we find 
that the encoded signal at the receiver input is identical to the encoded 
signal at the transmitter ouput. The corresponding receiver output differs 
from the original message signal only by the quantizing error incurred as 
a result of quantizing the prediction error. 

From the foregoing analysis we observe that, in a noise-free environ- 
ment, the prediction filters in the transmitter and receiver operate on the 
same sequence of samples, {m,(nT,)}. It is with this purpose in mind that 
a feedback path is added to the quantizer in the transmitter, as shown in 
Fig. 5.14a. 

The average power of the message sequence {m(nT,)} is given by 


1 NEI 
Pa = >} m(nT,) (5.30) 
N n=0 


where N is the length of the message sequence. The average power of the 
quantizing error sequence {q,(nT,)}, also assumed to be of length N, is 
given by 


qe(nT,) (5.31) 


We may thus define the output signal-to-quantizing noise ratio of a DPCM 
system as 


(SNR), = 2 (5.32) 


It is clear that we may rewrite Eq. 5.32 as 


P 
fe = G,(SNR)o 
q 


where (SNR)g is the signal-to-quantizing noise ratio defined by 


(SNR)g = = (5733) 


q 
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and G, is the prediction gain produced by the differential quantization 
scheme, defined by 


C= (5.34) 


The quantity G,, when greater than unity, represents the gain in signal- 
to-noise ratio that is due to the differential quantization scheme of Fig. 
5.14. Now for a given message signal, the average power P,, is fixed, so 
that G, is maximized by minimizing the average prediction error power 
P.. Accordingly, our objective should be to design the prediction filter so 
as to minimize P,, while the signal-to-quantizing noise ratio is maintained 
constant. 


THE PREDICTION FILTER 


One approach to specify the nature of the prediction filters in the trans- 
mitter and the receiver of the DPCM system shown in Fig. 5.14 is to use 
a tapped-delay-line filter as the basis of the design. An advantage of this 
approach is that it leads to tractable mathematics, and it is simple to 
implement. Thus the predicted value *#(nT,) is modeled as a linear com- 
bination of past values of the quantized input as shown by (see Fig. 5.15) 


P 
m(nT,) = X, wem,(nT, — kT.) (5.35) 
k=1 


where the tap weights w,, w2, . . . , w, define the prediction filter coeffi- 
cients, and p is the order of the prediction filter. Substitution of Eq. 5.35 
in 5.25 yields the prediction error 


e(nT,) = m(nT,) — E w.m,(nT, — kT,) (5.36) 


ma, (nT) 


m(nT,) 


Figure 5.15 
Tapped-delay-line filter used as a prediction filter. 
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The mathematical basis for the design of the prediction filter is that of 
minimizing the average prediction-error power with respect to the tap weights 
of the filter.’ 


5.8 DELTA MODULATION 


The exploitation of signal correlations in DPCM suggests the further pos- 
sibility of oversampling a message signal (i.e., at a rate much higher than 
the Nyquist rate) to purposely increase the correlation between adjacent 
samples of the signal. This would permit the use of a simple quantizing 
strategy for constructing the encoded signal. Delta modulation (DM), which 
is the one-bit (or two-level) version of DPCM, is precisely such a scheme. 

In its simple form, DM provides a staircase approximation to the over- 
sampled version of an incoming message signal, as illustrated in Fig. 5.16a. 
The difference between the input and the approximation is quantized into 
only two representation levels, namely, +ô, corresponding to positive and 
negative differences. Thus, if the approximation falls below the signal at 
any sampling epoch, it is increased by ô. If, on the other hand, the ap- 
proximation lies above the signal, it is diminished by ô. Provided that the 
signal does not change too rapidly from sample to sample, we find that 
the staircase approximation remains within +6 of the input signal. 

Denoting the input signal as m(t) and the staircase approximation as 
m,(t), the basic principle of delta modulation may be formalized in the 
following set of discrete-time relations: 


e(nT,) = m(nT,) — m,(nT, — T,) (S337) 
e,(nT,) = 6 sgnfe(nT,)] (5.38) 

and 
m,(nT,) = m,(nT, — T) + e,(nT,) (5.39) 


“The result of this minimization is a set of simultaneous equations, expressed in 
matrix form as follows 


1 AT.) + plpT, — T) || mw p(T.) 
AT.) 1 PPTs — 273) || we} _ | p(2T,) 
APT,- T) plpT, ~ 2T) | 1 m| Lol pT,) 


Here it is assumed that the ouput signal-to-noise ratio, (SNR)o, is large compared to 
unity. The parameter p(kT,) is the normalized autocorrelation function of the 
prediction filter's input signal for a lag of kT,, as shown by 


Ru(kT;) 
(kT) = ———, ($0) Iposar 
P Ry (0) á 
where the subscript M refers to the input. Hence, given the set of autocorrelation 
functions {Ry(kT,), k = 0, 1,..., p}, we may compute the prediction filter’s tap 


weights. For a-detailed treatment of prediction filters, see the following books: 
Jayant and Noll (1984) and Haykin (1986). 
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Figure 5.16 
Delta modulation 


where T, is the sampling period; e(nT,) is an error signal representing the 
difference between the present sample value m(nT,) of the input signal 
and the latest approximation to it, namely, m(nT,) = m,(nT, — T,); and 
e,(nT,) is the quantized version of e(nT,). The quantizer output e,(”7,) 
is the desired DM wave for varying n. 

Part a of Fig. 5.16 illustrates the way in which the staircase approxi- 
mation m,(t) follows variations in the input signal m(t) in accordance with 
Egs. 5.37 through 5.39, and part b of the figure displays the corresponding 
binary sequence at the delta modulator output. It is apparent that in a 
delta modulation system the rate of information transmission is simply 
equal to the sampling rate 1/T,. 

The principal virtue of delta modulation is its simplicity. It may be 
generated by applying the sampled version of the incoming message signal 
to a modulator that involves a summer, quantizer, and accumulator inter- 
connected as shown in Fig. 5.17a. Details of the modulator follow directly 
from Eqs. 5.37 and 5.39. In particular, the quantizer consists of a hard 
limiter with an input-output relation defined by Eq. 5.38, which is depicted 
in Fig. 5.18. The quantizer output is applied to an accumulator, producing 
the result 


m,(nT,) = ô X, senle(iT,) 


= È e,(iT,) (5.40) 
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Figure 5.17 
DM system. (a) Transmitter. (b) Receiver. 
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Figure 5.18 
Input-output characteristic of quantizer for DM system. 
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which is obtained by solving Eqs. 5.38 and 5.39 for m,(nT,). Thus, at the 
sampling instant nT,, the accumulator increments the approximation by 
an amount equal to ô in a positive or negative direction, depending on the 
algebraic sign of the error signal e(n T,). If the input signal m(nT,) is greater 
than the most recent approximation m(nT,), a positive increment +ô is 
applied to the approximation. If, on the other hand, the input signal is 
smaller, a negative increment — ô is applied to the approximation. In this 
way, the accumulator does the best it can to track the input samples by 
one step at a time. In the receiver, shown in Fig. 5.17), the staircase 
approximation m,(t) is reconstructed by passing the sequence of positive 
and negative pulses, produced at the decoder output, through an accu- 
mulator in a manner similar to that used in the transmitter. The out-of- 
band quantizing noise in the high-frequency staircase waveform m,(t) is 
rejected by passing it through a low-pass filter with a bandwidth equal to 
the original message bandwidth. 

In comparing the DPCM and DM networks of Fig. 5.14 and 5.17, we 
note that they are similar, except for two important differences, namely, 
the use of a one-bit (two-level) quantizer in the delta modulator and the 
replacement of the prediction filter by a single delay element. 


QUANTIZING NOISE 


Delta modulation systems are subject to two types of quantizing error: (1) 
slope overload distortion, and (2) granular noise. We first discuss the cause 
of slope overload distortion, and then granular noise. 

We observe that Eq. 5.40 is the digital equivalent of integration in the 
sense that it represents the accumulation of positive and negative incre- 
ments of magnitude ô. Also, denoting the quantizing error by q,(nT,), as 
shown by, 


m,(nT,) = m(nT,) + q.(nT,) (5.41) 
we observe from Eq. 5.37 that the input to the quantizer is 
e(nT,) = m(nT,) a m(nT, oa T) a q.(nT, E T;) (5.42) 


Thus, except for the quantizing error g,(nT, — T,), the quantizer input is 
a first backward difference of the input signal, which may be viewed as a 
digital approximation to the derivative of the input signal or, equivalently, 
as the inverse of the digital integration process. If we consider the maximum 
slope of the original input waveform m(t), it is clear that in order for the 
quantized sequence {m,(nT,)} to increase as fast as the message sequence 
{m(nT,)} in a region of maximum slope of m(t), we require that the con- 
dition 

d m(t) 


a (5.43) 


ee ax 
T, 
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Figure 5.19 
Quantizing error in delta modulation. 


be satisfied. Otherwise, we find that the absolute value of the representation 
level ô is too small for the staircase approximation m(t) to follow a steep 
segment of the input waveform m(t), with the result that m,(t) falls behind 
m(t), as illustrated in Fig. 5.19. This condition is called slope overload, 
and the resulting quantizing error is called slope-overload distortion (noise). 
Note that since the maximum slope of the staircase approximation m(t) 
is fixed by the value of ô, increases and decreases in m,(t) tend to occur 
along straight lines. For this reason, a delta modulator using a fixed ô is 
often referred to as a linear delta modulator. 

In contrast to slope-overload distortion, granular noise occurs when 6 
is too large relative to the local slope characteristics of the input waveform 
m(t), thereby causing the staircase approximation m,(t) to hunt around a 
relatively flat segment of the input waveform; this phenomenon is also 
illustrated in Fig. 5.19. The granular noise is analogous to quantizing noise 
in a PCM system. 

We thus see that there is a need to have a large 6 so as to accommodate 
a wide dynamic range, whereas a small 6 is required for the accurate 
representation of relatively low-level signals. It is therefore clear that the 
choice of the optimum 6 that minimizes the mean-square value of the 
quantizing error in linear delta modulation will be the result of a compro- 
mise between slope overload distortion and granular noise. 


EXERCISE 6 From nee 5.18 we see > that the step size of a linear delta : 
modulator i is. 


= 20 


What is the average power of the granular noise expressed in terms of ô? 


jeoscsccececcsscesseee 9.9 DISCUSSION 


In this section we discuss the advantages and disadvantages of DPCM and 
DM, compared with standard PCM, for the encoding of voice and television 
signals. 
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The “relative” behavior of standard PCM and DPCM systems is much 
the same with either uniform or logarithmic quantizing, because the rep- 
ertoire of signals consists of waveforms similar in character, but differing 
in mean level. In the case of voice signals, it is found that the signal-to- 
quantizing noise advantage of DPCM over standard PCM is in the neigh- 
borhood of 4-11 dB. The greatest improvement occurs in going from no 
prediction to first-order prediction, with some additional gain resulting 
from increasing the order of the prediction filter up to 4 or 5, after which 
little additional gain is obtained. Since 6 dB of quantizing noise is equivalent 
to 1 bit per sample, by virtue of Eq. 5.21, the advantage of DPCM may 
also be expressed in terms of bit rate. For a constant signal-to-quantizing 
noise ratio, and assuming a sampling rate of 8 kHz, the use of DPCM may 
provide a saving of about 8-16 kilobits per second (1 to 2 bits per sample) 
over standard PCM. 

In the case of television signals, DPCM provides more of an advantage 
for high-resolution television systems than for low-resolution systems. For 
monochrome entertainment television, DPCM provides a signal-to-quan- 
tizing noise ratio of approximately 12 dB higher than standard PCM. For 
a constant signal-to-quantizing noise ratio, and assuming a sampling rate 
of 9 MHz, this represents a saving of about 18 megabits per second (2 bits 
per sample) by DPCM over PCM. 

Turning next to delta modulation, subjective voice tests and noise mea- 
surements have shown that a DM system operating at 40 kilobits per second 
is equivalent to a standard PCM system operating with a sampling rate of 
8 kHz and 5 bits per sample. At lower bit rates, DM is better than the 
standard PCM (the latter still using 8-kHz sampling and a reduced number 
of bits per sample), but at higher bit rates PCM is superior to DM. The 
quality of 5-bit PCM is low for most purposes in telephony. For telephone 
quality voice signals, it has become conventional to use 8-bit PCM. Equiv- 
alent voice quality with DM can be obtained only by using bit rates much 
higher than 64 kilobits per second. 

Also, in a delta modulation system, operating on voice signals under 
optimum conditions, the SNR is increased by 9 dB by doubling the bit 
rate. By comparison, in the case of standard PCM, we achieve a 6 dB 
increase in SNR for each added bit. For example, by doubling the bit rate 
from 40 to 80 kilobits per second, the SNR is increased by 9 dB using DM. 
On the other hand, if PCM is employed and the bit rate is similarly doubled 
by increasing the number of bits per sample from 5 to 10 (keeping the 
sampling rate fixed at 8 kHz), the SNR is improved by 30 dB. Thus the 
increase of SNR with bit rate is much more dramatic for PCM than for 
DM. 

The use of delta modulation is therefore recommended only in certain 
special circumstances: (1) if it is necessary to reduce the bit rate below 40 
kilobits per second and limited voice quality is tolerable; or (2) if extreme 
circuit simplicity is of overriding importance and the accompanying use of 
a high-bit rate is acceptable. Note that since delta modulation uses a high 
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sampling rate, there is no need for employing a pre-alias filter prior to 
sampling in the transmitter. 


ADAPTIVE DIGITAL CODING OF WAVEFORMS 


From the discussion presented on PCM using a uniform quantizer with a 
fixed step size, we see that we have a dilemma in quantizing speech signals. 
On the one hand, we wish to choose the quantization step size large enough 
to accommodate the maximum peak-to-peak range of the input signal with 
the lowest possible number of representation levels. On the other hand, 
we would like to make the quantization step size small enough to minimize 
the average power of the quantizing noise. This issue is further compounded 
by the fact that the amplitude of the speech signal can vary over a wide 
range, depending on the speaker, the communication environment, and 
within a given utterance, from voiced to unvoiced sounds. One approach 
to accommodating these conflicting requirements is to use a nonuniform 
quantizer; this approach is commonly used in PCM systems for telephony 
as described in Section 5.4. An alternative approach is to use an adaptive 
quantizer, wherein the step size is varied automatically so as to match the 
average power of the input speech signal; this second approach is commonly 
used in adaptive DPCM (ADPCM) systems. 

In ADPCM systems used in telephony, the prediction filter is also adap- 
tive. An adaptive prediction filter is responsive to changing level and spec- 
trum of the input speech signal. The variation of performance with speakers 
and speech material, together with variations in signal level inherent in the 
speech communication process, make the combined use of adaptive quan- 
tization and adaptive prediction necessary to achieve best performance 
over a wide range of speakers and speaking situations. 

It is of interest to note that improvements in circuit design and tech- 
nology have made it possible for ADPCM to provide toll quality speech 
coding at 32 kb/s’; this corresponds to a sampling rate of 8 kHz and 4 bits 
per sample. By “toll quality” we mean the quality of commercial telephone 
service. This performance is comparable to that of 64 kb/s PCM incor- 
porating the use of y-law (logarithmic) companding with y = 255. How- 
ever, unlike log-PCM, the performance of the ADPCM system is very 
signal dependent. 

Finally, we should mention that a delta modulator may also be made 
adaptive, wherein the variable step size increases during a steep segment 


Voiced sounds are produced by forcing air through the glottis with the tension of 
the vocal cords adjusted so that they vibrate in a relaxation oscillation, thereby 
producing quasiperiodic pulses of air that excite the vocal tract. Fricative or 
unvoiced sounds are generated by forming a constriction at some point in the vocal 
tract (usually toward the mouth end) and forcing air through the constriction at a 
high enough velocity to produce turbulence. This creates a broad-spectrum noise 
source to excite the vocal tract. 

7Jayant and Noll, 1984, pp. 309-311. 
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of the input signal and decreases when the modulator is quantizing an input 
signal with a slowly varying segment. In this way the step size is adapted 
to the level of the input signal. The resulting system is called an adaptive 
delta modulator (ADM). 


5.10 TIME-DIVISION MULTIPLEXING 


The sampling theorem enables us to transmit the complete information 
contained in a band-limited message signal by using samples of the message 
signal taken uniformly at a rate that is usually slightly higher than the 
Nyquist rate. An important feature of the sampling process is a conser- 
vation of time. That is, the transmission of the message samples engages 
the transmission channel for only a fraction of the sampling interval on a 
periodic basis, and in this way some of the time interval between adjacent 
samples is cleared for use by other independent message sources on a time- 
shared basis. We thereby obtain a time-division multiplex system (TDM), 
which enables the joint use of a common transmission channel by a plurality 
of independent message sources without mutual interference. 

The concept of TDM is illustrated by the block diagram shown in Fig. 
5.20. Each input message signal is first restricted in bandwidth by a low- 
pass filter to remove the frequencies that are nonessential to an adequate 
signal representation. The low-pass filter outputs are then applied to a 
commutator that is usually implemented using electronic switching cir- 
cuitry. The function of the commutator is two-fold: (1) to take a narrow 
sample of each of the N input messages at a rate 1/T, that is slightly higher 
than 2W, where W is the cutoff frequency of the low-pass input filter, and 
(2) to sequentially interleave these N samples inside a sampling interval 
T,. Indeed, this latter function is the essence of the time-division multi- 
plexing operation. Following the commutation process, the multiplexed 
signal is applied to a pulse modulator, (e.g., pulse-amplitude modulator), 
the purpose of which is to transform the multiplexed signal into a form 
suitable for transmission over the common channel. It is clear that the use 
of time-division multiplexing introduces a bandwidth expansion factor N, 
because the scheme must squeeze N samples derived from N independent 
message sources into a time slot equal to one sampling interval. At the 
receiving end of the system, the received signal is applied to a pulse de- 
modulator, which performs the inverse operation of the pulse modulator. 
The narrow samples produced at the pulse demodulator output are dis- 
tributed to the appropriate low-pass reconstruction filters by means of a 
decommutator, which operates in synchronism with the commutator in the 
transmitter. This synchronization is essential for the satisfactory operation 
of the system. 

The TDM system is highly sensitive to dispersion in the common trans- 
mission channel, that is, to variations of amplitude with frequency or non- 
linear phase response. Accordingly, accurate equalization of both the am- 
plitude and phase responses of the channel is necessary to ensure a satisfactory 
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operation of the system. This issue is discussed in Chapter 6. To a first 
approximation, however, TDM is immune to amplitude nonlinearities in 
the channel as a source of crosstalk, because the different message signals 
are not simultaneously impressed on the channel. 


5.11 APPLICATION: DIGITAL MULTIPLEXERS FOR TELEPHONY 


In the previous section we introduced the idea of time-division multiplexing 
whereby a group of analog signals (e.g., voice signals) are sampled se- 
quentially in time at a common sampling rate and then multiplexed for 
transmission over a common line. In this section we consider the multi- 
plexing of digital signals? at different bit rates. This enables us to combine 
several digital signals, such as computer outputs, digitized voice signals, 
and digitized facsimile and television signals, into a single data stream (at 
a considerably higher bit rate than any of the inputs). Figure 5.21 shows 
a conceptual diagram of the digital multiplexing—demultiplexing operation. 

The multiplexing of digital signals may be accomplished by using a bit- 
by-bit interleaving procedure with a selector switch that sequentially takes 
a bit from each incoming line and then applies it to the high-speed common 
line. At the receiving end of the system the output of this common line is 
separated out into its individual low-speed components and then delivered 
to their respective destinations. 

Two major groups of digital multiplexers are used in practice: 


1. One group of multiplexers is designed to combine relatively low-speed 
digital signals, up to a maximum rate of 4800 bits per second, into a 
higher speed multiplexed signal with a rate of up to 9600 bits per second. 
These multiplexers are used primarily to transmit data over voice-grade 
channels of a telephone network. Their implementation requires the 
use of modems in order to convert the digital format into an analog 
format suitable for transmission over telephone channels. The operation 
of a modem (modulator—demodulator) is covered in Section 7.14. 


High—speed 
transmission Demul!tiplexer 
line 


Data sources Destinations 


Figure 5.21 
Conceptual diagram of multiplexing—demultiplexing. 


®For more detailed information on the multiplexing of digital signals, see Bel! 
Telephone Laboratories (1970). 
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2. The second group of multiplexers, designed to operate at much higher 


bit rates, forms part of the data transmission service generally provided 
by communication carriers. For example, Fig. 5.22 is a block diagram 
of the digital hierarchy based on the T1 carrier, which has been devel- 
oped by the Bell System. The T1 carrier, described later on, is designed 
to operate at 1.544 megabits per second, the T2 at 6.312 megabits per 
second, the T3 at 44.736 megabits per second, and the T4 at 274.176 
megabits per second. The system is thus made up of various combi- 
nations of lower order T-carrier subsystems. These subsystems are de- 
signed to accommodate the transmission of voice signals, Picture- 
phone® service, and television signals using'PCM, as well as (direct) 
digital signals from data terminal equipment. 


There are some basic problems involved in the design of a digital mul- 


tiplexer, irrespective of its grouping: 


ilk 


Digital signals cannot be directly interleaved into a format that allows 
for their eventual separation unless their bit rates are locked to a com- 
mon clock. Accordingly, provision has to be made for synchronization 
of the incoming digital signals, so that they can be properly interleaved. 
The multiplexed signal must include some form of framing, so that its 
individual components can be identified at the receiver. 

The multiplexer has to handle small variations in the bit rates of the 
incoming digital signals. For example, a 1000-kilometer coaxial cable 
carrying 3 x 10% pulses per second will have about 1 million pulses in 
transit, with each pulse occupying about 1 meter of the cable. A 0.01% 


2 


Voice Í 
signals iA 
24 


Digital 
data 


Multiplexer 


Picturephone® 


Television 


Figure 5.22 
Digital hierarchy, Bell system. 
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variation in the propagation delay, produced by a 1°F decrease in tem- 
perature, will result in 100 fewer pulses in the cable. Clearly, these 
pulses must be absorbed by the multiplexer. 


To cater to the requirements of synchronization and rate adjustment to 
accommodate small variations in the input data rates, we may use a tech- 
nique known as bit stuffing. The idea here is to have the outgoing bit rate 
of the multiplexer slightly higher than the sum of the maximum expected 
bit rates of the input channels. This is achieved by stuffing in additional 
non-information-carrying pulses. All incoming digital signals are stuffed 
with a number of bits sufficient to raise their respective bit rates to that of 
a locally generated clock. To accomplish bit stuffing, each incoming digital 
signal or bit stream is fed into an elastic store at the multiplexer. The elastic 
store is a device that stores a bit stream in such a manner that the stream 
may be read out at a rate different from the rate at which it is read in. At 
the demultiplexer, the stuffed bits must obviously be removed from the 
multiplexed signal. This requires some method of identifying the stuffed 
bits. To illustrate one such method, and also to show one method of 
providing frame synchronization, we describe the signal format of the Bell 
System M12 multiplexer, which is designed to combine four T1 bit streams 
into one T2 bit stream. We begin the description by considering the T1 
system. 


T1 SYSTEM 


The TI carrier system is designed to accommodate 24 voice channels, pri- 
marily for short-distance, heavy usage in metropolitan areas. The T1 system 
was pioneered by the Bell System in the United States in the early 1960s, 
and with its introduction the shift to digital communication facilities started. 
The T1 system has been adopted for use throughout the United States, 
Canada, and Japan. It forms the basis for a complete hierarchy of higher- 
order multiplexed systems that are used for either long-distance transmis- 
sion or transmission in heavily populated urban centers. 

A voice signal (male or female) is essentially limited to a band from 300 
to 3400 Hz in the sense that frequencies outside this band do not contribute 
much to articulation efficiency. Indeed, telephone circuits that respond to 
this range of frequencies give quite satisfactory service. Accordingly, it is 
customary to pass the voice signal through a low-pass filter with a cutoff 
frequency of about 3.4 kHz prior to sampling. Hence, the nominal value 
of the Nyquist rate is 6.8 kHz. The filtered voice signal is usually sampled 
at a slightly higher rate, namely, 8 kHz, which is the standard sampling 
rate in digital telephony. 

For companding, the T1 system uses a piecewise-linear characteristic 
(consisting of 15 linear segments) to approximate the logarithmic y-law of 
Eq. 5.16 with the constant u = 255. This approximation is constructed in 
such a way that the segment end points lie on the compression curve 
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computed from Eq. 5.16, and their projections onto the vertical axis are 
spaced uniformly. Table 5.4 gives the projections of the segment end points 
onto the horizontal axis and the step sizes of the individual segments. The 
table is normalized to 8159, so that all values are represented as integer 
numbers. Segment 0 of the approximation is a linear segment, passing 
through the origin; it contains a total of 31 uniform representation levels. 
Linear segments la, 2a, ..., 7a lie above the horizontal axis, whereas 
linear segments 1b, 2b, ..., 7b lie below the horizontal axis; each of 
these 14 segments contains 16 uniform representation levels. For colinear 
segment 0 the representation levels at the compressor input are +1, +3, 

. , +31, and the corresponding compressor ‘output levels are 0, +1, 

. ., +15. For linear segments 1a and 1b the representation levels at the 
compressor input are +33, +35, ..., +95, and the corresponding com- 
pressor output levels are +16, +17, ..., +31, and so on for the other 
linear segments. 

There are a total of 31 + 14 x 16 = 255 output levels associated with 
the 15-segment companding characteristic described herein. To accom- 
modate this number of output levels, each of the 24 voice channels uses a 
binary code with an 8-bit word. The first bit indicates whether the input 
voice sample is positive or negative. The next three bits of the code word 
identify the particular segment inside which the amplitude of the input 
voice sample lies, and the last four bits identify the actual quantizing step 
inside that segment. 


With a sampling rate of 8 kHz, each frame of the multiplexed signal 
occupies a period of 125 ys. In particular, it consists of twenty-four 
8-bit words, plus a single bit that is added at the end of the frame for the 
purpose of synchronization. Hence, each frame consists of a total of 
24 x 8 + 1 = 193 bits. Correspondingly, the duration of each bit equals 
0.647 us, and the resultant transmission rate is 1.544 megabits per second. 

In addition to the voice signal, a telephone system must also pass special 


TABLE 5.4 The 15-Segment y-law Companding Characteristic (u = 255) 


Projections of 


Linear Segment Segment End Point 
Number Step Size onto the Horizontal Axis 
0 2 +31 
la, 1b 4 +95 
le AD 8 2023 
3a, 3b 16 +479 
4a, 4b 32 +991 
Sa, 5b 64 +2015 
6a, 6b 128 +4063 
7a, 7b 256 +8159 


a 
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supervisory signals to the far end. This signaling information is needed to 
transmit dial pulses, as well as telephone off-hook/on-hook signals. In the 
T1 system this requirement is accomplished as follows. Every sixth frame, 
the least significant (i.e., the eighth) bit of each voice channel is deleted 
and a signaling bit is inserted in its place, thereby yielding an average 73- 
bit operation for each voice input. The sequence of signaling bits is thus 
transmitted at a rate equal to the sampling rate divided by six, that is, 
1.333 kilobits per second. 


M12 MULTIPLEXER 


Figure 5.23 illustrates the signal format of the M12 multiplexer. Each frame 
is subdivided into four subframes. The first subframe (first line in Fig. 5.23) 
is transmitted, then the second, the third, and the fourth, in that order. 
Bit-by-bit interleaving of the incoming four T1 bit streams is used to 
accumulate a total of 48 bits, 12 from each input. A control bit is then 
inserted by the multiplexer. Each frame contains a total of 24 control bits, 
separated by sequences of 48 data bits. Three types of control bits are used 
in the M12 multiplexer to provide synchronization and frame indication, 
and to identify which of the four input signals has been stuffed. These 
control bits are labeled as F, M, and C in Fig. 5.23. Their functions are: 


1. The F-control bits, two per subframe, constitute the main framing pulses. 
The subscripts on the F-control bits denote the actual bit (0 or 1) 
transmitted. Thus the main framing sequence is FoF; FoF, FoF; FoF, or 
01010101. 

2. The M-control bits, one per subframe, form secondary framing pulses 
to identify the four subframes. Here again the subscripts on the M- 
control bits denote the actual bit (0 or 1) transmitted. Thus the secondary 
framing sequence is MoM, M, M; or 0111. 

3. The C-control bits, three per subframe are stuffing indicators. In par- 
ticular, C, refers to input channel I, C,, refers to input channel II, and 
so forth. For example, the three C-control bits following Mo in the first 
subframe are stuffing indicators for the first T1 signal. The insertion of 
a stuffed bit in this T1 signal is indicated by setting all three C-control 
bits to 1. To indicate no stuffing, all three are set to 0. If the three C- 
control bits indicate stuffing, the stuffed bit is located in the position of 


M, [48] G [48] F, [48] Ci [48] C [48] F, [48] 
M, [48] Cu [48] Fo [48] Cu [48] Cy [48] F [48] 
M, [48] Cm [48] Fo [48] Cm [48] Cu [48] F, [48] 
M, [48] Cy [48] Fo [48] Cw [48] Cy [48] F, [48] 


Figure 5.23 
Signal format of Bell system M12 multiplexer. 
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the first information bit associated with the first T1 signal that follows 
the F,-control bit in the same subframe. In a similar way, the second, 
third, and fourth T1 signals may be stuffed, as required. By using ma- 
jority logic decoding in the receiver, a single error in any of the three 
C-control bits can be detected. This form of decoding means simply 
that the majority of the C-control bits determine whether an all-one or 
all-zero sequence was transmitted. Thus three 1’s or combinations of 
two 1’s and a 0 indicate that a stuffed bit is present in the information 
sequence, following the control bit F, in the pertinent subframe. On 
the other hand, three 0’s or combinations of two 0’s and a 1 indicate 
that no stuffing is used. : 


The demultiplexer at the receiving M12 unit first searches for the main 
framing sequence FoF, FoF, FyF,FyF,. This establishes identity for the four 
input T1 signals and also for the M- and C-control bits. From the M, M, M, M, 
sequence, the correct framing of the C-control bits is verified. Finally, the 
four T1 signals are properly demultiplexed and destuffed. 

This signal format has two safeguards: 


1. It is possible, although unlikely, that with just the FoF, FF FoF, AF, 
sequence, one of the incoming T1 signals may contain a similar se- 
quence. This could then cause the receiver to lock onto the wrong 
sequence. The presence of the M,M,M,M, sequence provides verifi- 
cation of the genuine FoF, FoF, FoF, FF, sequence, thereby ensuring 
that the four T1 signals are properly demultiplexed. 

2. The single-error correction capability built into the C-control bits en- 
sures that the four T1 signals are properly destuffed. 


EXAMPLE 5: CAPACITY OF M12 MULTIPLEXER 


The capacity of the M12 multiplexer to accommodate small variations in 
the input data rates can be calculated from the format of Fig. 5.23. In each 
M frame, defined as the interval containing one cycle of MM, M, M, bits, 
one bit can be stuffed into each of four input T1 signals. Each such signal 
has 12 x 6 x 4 = 288 positions in each M frame. Also the T1 signal has 
a bit rate equal to 1.544 megabits per second. Hence, each input can be 
incremented by 


l 
1.544 x 106 x — = 5.4 kilobi 
44 10° x 788 5.4 kilobits/s 


; This result is much larger than the expected change in the bit rate of the 
: incoming T1 signal. It follows therefore that the use of only one stuffed 
bit per input channel in each frame is sufficient to accommodate expected 
variations in the input signal rate. 
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The local clock that determines the outgoing bit rate also determines 
the nominal stuffing rate S, defined as the average number of bits stuffed į 
per channel in any frame. The M12 multiplexer is designed for § = 1/3. 
Accordingly, the nominal bit rate of the T2 line is 


49 288 
1.544 x 4 x a8 7885 ~ 6.312 megabits/s 


This also ensures that the nominal T2 clock frequency is a multiple of 8 
kHz (the nominal sampling rate of a voice signal), which is a desirable 
feature. 
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EXERCISE 7 Given ihat the data rate for 
6.312 megabits per second, and that for one 

_ megabits per second, determine the capacity 
level measured in terms of the number of (a) voice, (b) pictureph« yt 


2 a channels ot it c can Acora ee 2, 
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PROBLEMS 
P5.3 Sampling 


Problem 1 Figure P5.1 depicts the spectrum of a message signal m(t). 
The signal is undersampled at a rate of 1.5 Hz. 


(a) Sketch the spectrum of the sampled version of this signal. 

(b) The sampled signal is passed through an idealized low-pass inter- 
polation filter of bandwidth 1 Hz. Sketch the spectrum of the resulting 
filter output. 


M(f) 


Figure P5.1 


Problem 2 Consider the operation of a sample-and-hold circuit with the 
following parameters: 
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Message bandwidth, W = 1 Hz 
Sampling period, T, = 0.4 s 
Pulse duration, T = 0.2 s 


(a) Calculate the amplitude distortion produced by the aperture effect 
(arising from the use of flat-top samples) at the highest frequency com- 
ponent of the message signal. 

(b) Find the amplitude response of the equalizer required to compensate 
for the aperture effect. 


P5.4 Quantizing 
Problem 3 


(a) A sinusoidal signal, with an amplitude of 3.25 V is applied to a 
uniform quantizer of the midtread type with output values of 0, +1, +2, 
+3 V, as in Fig. P5.2a. Sketch the waveform of the resulting quantizer 
output for one complete cycle of the input. 

(b) Repeat this evaluation for the case when the quantizer is of the 
midriser type with output values +0.5, +1.5, +2.5, +3.5 V, as in Fig. 
Poop. 


Problem 4 The signal 
m(t) = 6 sin(2z2) volts 
is transmitted using a 4-bit binary PCM system. The quantizer is of the 


midriser type, with a step size of 1 V. Sketch the resulting sequence of 
quantized samples for one complete cycle of the input. Assume a sampling 


Output Output 
(volts) (volts) 


Input 


Input 
(volts) 5 


4 (volts) 


(b) 
Figure P5.2 
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Figure P5.3 


rate of four samples per second, with samples taken at £ = +1/8, +3/8, 
+5/8,... , seconds. 


P5.5 Coding 
Problem 5 Consider the following binary sequences: 


(a) An alternating sequence of 1’s and 0’s. 

(b) A long sequence of 1’s followed by a long sequence of 0’s. 

(c) A long sequence of 1’s followed by a single 0 and than a long 
sequence of 1’s. 


Sketch the waveform for each of these sequences using the following meth- 
ods of representing symbols 1 and 0: 


(a) On-off signaling. 

(b) Polar signaling. 

(c) Return-to-zero signaling. 
(d) Bipolar signaling. 

(e) Manchester code. 


Problem 6 Figure P5.3 shows a PCM wave in which the amplitude levels 
of +1 V and —1 V are used to represent binary symbols 1 and 0, respec- 
tively. The code word used consists of three bits. Find the sampled version 
of an analog signal from which this PCM wave is derived. 


Problem 7 The bipolar waveform of Fig. 5.12d, representing the binary 
sequence 0110100011, is transmitted over a noisy channel. The received 
waveform is shown in Fig. P5.4, which contains a single error. Locate the 
position of this error, giving reasons for your answer. 


Tp 


Figure P5.4 
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Problem 8 A PCM system uses a uniform quantizer followed by a 7-bit 
binary encoder. The bit rate of the system is equal to 50 megabits per 
second. 


(a) What is the maximum message bandwidth for which the system 
operates satisfactorily? 

(b) Determine the output signal-to-quantizing noise ratio when a full- 
load sinusoidal modulating wave of frequency 1 MHz is applied to the 
input. 


P5.7 Differential Pulse-Code Modulation 


Problem 9 In the DPCM system depicted in Fig. P5.5, show that in the 
absence of noise in the channel, the transmitting and receiving prediction 
filters operate on slightly different input signals. 


P5.8 Delta Modulation 


Problem 10 Consider a sine wave of frequency fm and amplitude An, 
applied to a delta modulator with representation levels +6. Show that 
slope-overload distortion will occur if 


ô 
27f mT, 


Am > 


where T, is the sampling period. What is the maximum power that may 
be transmitted without slope-overload distortion? 


Problem 11 The ramp signal m(t) = at is applied to a delta modulator 
that operates with a sampling period T, and representation levels +ô. 


(a) Show that slope-overload distortion occurs if ô < aT,. 
(b) Sketch the modulator output for the following three values of ô: 


(i) ô = 0.75 aT, 
(ii) ô = aT, 
(iii) 6 = 1.25 aT, 


m(nT,) Quan— Output 
tizer and 
coder | 
| | 
| | 
Predic- | | Predic.- 
tion filter | tion filter 
| | 
a Transmitter —— k-———____. Receiver —————____»- 


Figure P5.5 
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Problem 12 Consider a speech signal with maximum frequency of 3.4 
kHz and maximum amplitude of 1 V. This speech signal is applied to a 
delta modulator with its bit rate set at 20 kilobits per second. Discuss the 
choice of an appropriate step size for the modulator. 


P5.10 Time-Division Multiplexing 


Problem 13 Six independent message sources of bandwidths W, W, 2W, 
2W, 3W, and 3 W hertz are to be transmitted on a time-division multiplexed 
basis using a common communication channel. 


(a) Set up a scheme for accomplishing this multiplexing requirement, 
with each message signal sampled at its Nyquist rate. 
(b) Determine the minimum transmission bandwidth of the channel. 


Problem 14 Twenty-four voice signals are sampled uniformly and then 
time-division multiplexed. The sampling operation uses flat-top samples 
with 1 ws duration. The multiplexing operation includes provision for syn- 
chronization by adding an extra pulse of sufficient amplitude and also 1 ys 
duration. The highest frequency component of each voice signal is 3.4 kHz. 


(a) Assuming a sampling rate of 8 kHz, calculate the spacing between 
successive pulses of the multiplexed signal. 
(b) Repeat your calculation assuming the use of Nyquist rate sampling. 
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CHAPTER SIX 


INTERSYMBOL INTERFERENCE 


Wes digital data (of whatever origin) is transmitted over a band- 
limited channel, dispersion in the channel gives rise to a troublesome 
form of interference called intersymbol interference. As the name 
implies, intersymbol interference refers to interference caused by the 
time response of the channel spilling over from one symbol into another. 
This has the effect of introducing deviations (errors) between the data 
sequence reconstructed at the receiver output and the original data 
sequence applied to the transmitter input. Hence, unless corrective 
measures are taken, intersymbol interference may impose a limit on the 
attainable rate of data transmission that is far below the physical 
capability of the channel. 


227 
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In this chapter, we study the intersymbol interference problem and the 
use of baseband pulse shaping as the solution to the problem. The term 
“baseband” is used to designate the band of frequencies representing the 
original signal as delivered by a source of information. 


ZOO 6.1 BASEBAND TRANSMISSION OF BINARY DATA 


E) 


C For the baseband transmission of digital data, the use of discrete pulse- 
{ amplitude modulation (PAM) provides the most efficient form of discrete 


pulse modulation in terms of power and bandwidth use. In discrete PAM, 
the amplitude of the transmitted pulses is varied in a discrete manner in 
accordance with the given digital data. 

The basic elements of a baseband binary PAM system are shown in Fig. 
6.1. The signal applied to the input of the system consists of a binary data 
sequence {b,} with a bit duration of T, seconds; b; is in the form of 1 or 
0. This signal is applied to a pulse generator, producing the pulse waveform 


x(t) = DS Asg(t — kT) (6.1) 


where g(t) denotes a shaping pulse with its value at time t = 0 defined by 


g0) = 1 


The amplitude A, depends on the identity of the input bit b,; specifically, 

we assume that 

{ + a, ~ if the input bit b, is symbol 1 (6.2) 
— a, ifthe input bit b, is symbol 0 l 


The PAM signal x(t) passes through a transmitting filter of transfer 
function H7(f). The resulting filter output defines the transmitted signal, 
which is modified in a deterministic fashion as a result of transmission 
through the channel of transfer function Hc(f). The signal at the receiver 
input is passed through a receiving filter of transfer function Hz(f). This 
filter output is sampled synchronously with the transmitter, with the sam- 
pling instants being determined by a clock or timing signal that is usually 
extracted from the receiving filter output. Finally, the sequence of samples 
thus obtained is used to reconstruct the original data sequence by means 
of a decision device. The amplitude of each sample is compared to a thresh- 
old. If the threshold is exceeded, a decision is made in favor of symbol 1 
(say). If the threshold is not exceeded, a decision is made in favor of 
symbol 0. If the sample amplitude equals the threshold exactly, the symbol 
may be chosen as 0 or 1 without affecting overall performance. In such an 
event, we will choose symbol 0. 
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The model shown in Fig. 6.1 represents not only a data transmission 
system inherently baseband in nature (e.g., data transmission over a coaxial 
cable) but also the baseband equivalent of a linear modulation system used 
to transmit data over a band-pass channel (e.g., telephone channel). In 
the latter case, the baseband equivalent model of the data transmission 
system is developed by using the ideas presented in Section 3.5. Linear 
modulation techniques for transmitting digital data over band-pass channels 
are considered in Chapter 7. 


6.2 THE INTERSYMBOL INTERFERENCE PROBLEM 


For the present discussion, we assume that the channel is noiseless. We do 
so in order to focus attention on the effects of imperfections in the frequency 
response of the channel (i.e., dispersion of the pulse shape by the channel) 
on data transmission through the channel. The effect of channel noise on 
the receiver output is considered in Chapter 10. 

The receiving filter output in Fig. 6.1 may be written as! 


y(t) =u >) Ap(t — kTs) (6.3) 


k=-@ 


where y is a scaling factor. The pulse p(t) has a shape different from that 
of g(t), but it is normalized such that 


p(0) =1 


The pulse A,p(t) is the response of the cascade connection of the trans- 
mitting filter, the channel, and the receiving filter, which is produced by 
the pulse A,,g(t) applied to the input of this cascade connection. Therefore, 
we may relate p(t) to g(t) in the frequency domain as follows (after 
cancelling the common factor A,) 


uP(f) = G(f)Ar(f)Hc(f)Ae(f) (6.4) 


where P(f) and G(f) are the Fourier transforms of p(t) and g(t), re- 
spectively. 
The receiving filter output y(t) is sampled at time t; = iT, (with i taking 


'To be precise, an arbitrary time delay t, should be included in the argument of the 
pulse p(t — kT,) in Eq. 6.3 to represent the effect of transmission delay through the 
system. For convenience, we have put this delay equal to zero in Eq. 6.3. 
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on integer values), yielding 


y(t) =u > A,p[(i — k)T;] 


= -%0 


= wA;+ p> Ap[(i — k)T,] USOE E2, a GS) 
k=-% 


kAi 


In Eq. 6.5 the first term A; represents the contribution of the ith trans- 
mitted bit. The second term represents the residual effect of all other 
transmitted bits on the decoding of the ith received bit; this residual effect 
is called intersymbol interference (ISI). 

In the absence of ISI (and, of course, channel noise), we observe from 
Eq. 6.5 that 


y(t) = HA; (6.6) 


which shows that, under these conditions, the ith transmitted bit can be 
decoded correctly. The unavoidable presence of ISI in the system, however, 
introduces errors in the decision device at the receiver output. Therefore, 
in the design of the transmitting and receiving filters, the objective is to 
minimize the effects of ISI, and thereby deliver the digital data to its 
destination with the smallest error rate possible. 

Typically, the channel transfer function He(f) and the pulse spectrum 
G(f) are specified, and the problem is to determine the transfer functions 
of the transmitting and receiving filters, H;(f) and Hp(f), so as to enable 
the receiver to correctly decode the received sequence of sample values 
{y(t:)} in accordance with Eq. 6.6. Deviation from this ideal condition is 
caused by the presence of intersymbol interference that arises owing to 
dispersion of the pulse shape by the channel. To solve the problem, we 
have to exercise control over intersymbol interference, an issue that is 
discussed next. 


6.3 IDEAL SOLUTION 


Control of intersymbol interference in the system is achieved in the time 
domain by controlling the function p(t), or in the frequency domain by 
controlling P(f). One signal waveform that produces zero intersymbol 
interference is defined by the sinc function: 


_ sin(27Bot) 


p(t) = 2n B4 = sinc(2Bot) (6.7) 
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where 


1 


Bo = oT, 


(6.8) 


The parameter By is called the Nyquist bandwidth; it defines the minimum 
transmission bandwidth for zero intersymbol interference. According to 
Eq. 6.8, the Nyquist bandwidth B, is equal to one half of the bit rate 
1/T,. Note the analogy between this relation and the sampling theorem 
for strictly band-limited signals. (The sampling theorem was discussed in 
Sections 2.7 and 5.3). 

The frequency response P(f), representing the Fourier transform of the 
pulse p(t) of Eq. 6.7, is defined by 


1 
a Ve |< B 

Pa) aye ae (6.9) 
0 B, < |f| 


This means that no frequencies of absolute value exceeding half the bit 
rate are needed. The function p(t) can be regarded as the impulse response 
of an ideal low-pass filter with an amplitude response of 1/ (2By) in the 
passband and a bandwidth Bo. The function p(t) has its peak value at 
the origin and goes through zero at integer multiples of the bit duration 
Ts. It is apparent that if the received waveform y(t) is sampled at the in- 
stants of time t = 0, +T,, +27,, ... , then the pulses defined by 
Ajp(t — iT,) with arbitrary amplitude A; and i = 0, +1, Ba. whe 
will not interfere with each other. 

Although this ideal choice of pulse shape for p(t) achieves economy in 
bandwidth in that it solves the problem of zero intersymbol interference 
with the minimum bandwidth possible, there are two difficulties that make 
its use for system design impractical: 


Hd 


1. It requires that frequency response P(f) be flat from — B, to By, and 
zero elsewhere. This is physically unrealizable, and very difficult to 
approximate in practice because of the abrupt transitions at + By. 

2. The time function p(t) decreases as 1/|¢| for large |t|, resulting in a slow 
rate of decay. This is caused by the discontinuity of P(f) at +Bo. 
Accordingly, there is practically no margin of error in sampling times 
in the receiver. 


To evaluate the effect of this timing error, consider the sample of y(t) at 
t = At, where At is the timing error. To simplify the analysis, we have put 


pooocococococoocooteo 
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the correct sampling time ż; equal to zero. We thus obtain, in the absence 
of noise: 


y(4t) =u 2, Apát = R) 


u >, A, sinc[2B(4t — kT;)] 
k 


Since 2B,)T, = 1, we may rewrite this relation as 
y(At) = u >, A, sinc(2B, At — k) 
k 
oe At) Saar (= ete Ax 
2BuAt — k 


oD 


The first term on the right side of Eq. 6.10 defines the desired symbol, 
whereas the remaining series represents the intersymbol interference caused 
by the timing error 4¢ in sampling the signal y(t). In certain cases, it is 
possible for this series to diverge, thereby causing erroneous decisions in 
the receiver. 

We therefore have to look to other pulse shapes not only to combat the 
intersymbol interference problem but also to do so in a feasible way. In 
the next section, we present one such solution that is a natural extension 
of the minimum-bandwidth (ideal) solution just described. 


6.4 RAISED COSINE SPECTRUM 


The solution we have in mind differs from the ideal solution in one im- 
portant respect: the overall frequency response P(f) decreases toward 
zero gradually rather than abruptly. In particular, P(f) consists of a flat 
portion and a rolloff portion that has the form of a raised-cosine function, 
as follows” 


1 
2B. 0O<lfl<fi 
1 : 
PP) = \ am 1 + cos zUt, TE on 
07 1 
0, 2B fix fl 


(6.11) 


2?The solution described in Eq. 6.11 was first proposed by Nyquist (1928) in his 
studies of telegraph transmission theory. 
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The frequency f, and the Nyquist bandwidth Bo are related by 


Seah 
a= ae (6.12) 


which is called the rolloff factor. For a = 0, i.e., f; = Bo, we get the 
minimum bandwidth solution described in Section 6.3. 

The frequency response P(f), normalized by multiplying it by 2B, is 
plotted in Fig. 6.2a@ for three values of a, namely, 0, 0.5, and 1. We see 
that for a = 0.5 or 1, the function P(f) cuts off gradually as compared 
with an ideal low-pass filter (corresponding to a = 0), and it is therefore 
easier to realize in practice. Also the function P(f) exhibits odd symmetry 
about the cutoff frequency By of the ideal low-pass filter. 

The time response p(t), that is, the inverse Fourier transform of P(f), 
is defined by 


cos(2za@ Bot) 


p(t) = sinc(2Bot) 1 — 160°? 


(6.13) 


This function consists of the product of two factors: the factor sinc(2 Bot) 
associated with the ideal solution, and a second factor that decreases as 
1/|¢? for large |t|. The first factor ensures zero crossings of p(t) at the 
desired sampling instants of time ¢ = iT with i an integer (positive and 
negative). The second factor reduces the tails of the pulse considerably 
below that obtained from the ideal low-pass filter, so that the transmission 
of binary waves using such pulses is relatively insensitive to sampling time 
errors. In fact, the amount of intersymbol interference resulting from this 
timing error decreases as the rolloff factor a is increased from zero to unity. 

The time response p(t) is plotted in Fig. 6.2b for a = 0, 0.5 and 1. For 
the special case of a = 1, the function p(t) simplifies as 


_ sinc(4 Bot) 
PU) = | epee 16 B32 (6.14) 


This time response exhibits two interesting properties: 


1. Att = +T,/2 = +1/4B), we have p(t) = 0.5; that is, the pulse width 
measured at half amplitude is exactly equal to the bit duration T}. 

2. There are zero crossings at t = +3T,/2, + ST,/2, . . . in addition to 
the usual zero crossings at the sampling times t = +7,, +27,,.... 


These two properties are particularly useful in generating a timing signal 
from the received signal for the purpose of synchronization. 
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2B, Pif) 


(b) 


Figure 6.2 
Responses for different rolloff factors. (a) Frequency response. (b) Time response. 


EXERCISE 1 Given the frequency response P(f) defined in Eq. 6.11, 
show that the inverse Fourier transform p(t) is as given in Eq. 6.13. 
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TRANSMISSION BANDWIDTH REQUIREMENT 


From Eq. 6.11 we see that the nonzero portion of the frequency response 
P(f), resulting from use of the raised cosine spectrum, is limited to the 
interval (0, 2B) — fı) for positive frequencies. Accordingly, the transmis- 
sion bandwidth required by using the raised cosine spectrum is given by 


B = 2B, — fı (6.15) 
Eliminating the frequency fı between Eqs. 6.12 and 6.15, we get 
B=B(1+a) =. (6.16) 


where By is the Nyquist bandwidth and a is the rolloff factor. Thus, the 
transmission bandwidth requirement of the raised cosine solution exceeds 
that of the ideal solution by an amount equal to aBy. Note that the ratio 
of the excess bandwidth (resulting from the raised cosine solution) to the 
Nyquist bandwidth (required by the ideal solution) equals the rolloff fac- 
tor a. 

The following two cases, one ideal and the other practical, are of par- 
ticular interest: 


1. When the rolloff factor a is zero, the excess bandwidth «œB, is reduced 
to zero, thereby permitting the transmission bandwidth B to assume its 
minimum value Bo. 

2. When the rolloff factor a is unity, the excess bandwidth is increased to 
By. Correspondingly, the transmission bandwidth B is doubled, com- 
pared to the (ideal) case 1. 


EXAMPLE 1 BANDWIDTH REQUIREMENTS OF THE T1 SYSTEM 


In Chapter 5 we described the signal format for the T1 carrier system that 
is used to multiplex 24 independent voice inputs, based on an 8-bit PCM 
word. It was shown that the bit duration of the resulting time-division 
multiplexed signal (including a framing bit) is 


T, = 0.647 us 
The bit rate of the T1 system is 
1 
R, = = = 1.544 Mb/s 
T, 
Assuming an ideal low-pass characteristic for the channel, it follows that 


the Nyquist bandwidth of the T1 system is 


1 
B = —— = 
o= OF, 712 kHz 
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This is the minimum transmission bandwidth of the T1 system for zero 
intersymbol interference. However, a more realistic value for the trans- 
mission bandwidth B is obtained by using a raised cosine spectrum with 
a = 1. In this case, we find that 


B= = = 1.544 MHz 


b 
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EXERCISE 2 Calculate the transmission bandwidth requirement of the 
M12 multiplexer described in Section 5.11. Assume the use of a raised 
cosine spectrum with rolloff factor æ = 1 for the baseband pulse shaping. 


soona ...... 6.5 CORRELATIVE CODING 


Thus far we have treated intersymbol interference as an undesirable phe- 
nomenon that produces a degradation in system performance. Indeed, its 
very name connotes a nuisance effect. Nevertheless, by adding intersymbol 
interference to the transmitted signal in a controlled manner, it is possible 
to achieve a signaling rate of 2B) symbols per second in a channel of 
bandwidth Bo hertz. Such schemes are called correlative coding or partial- 
response signaling schemes.’ The design of these schemes is based on the 
premise that since the intersymbol interference that is introduced into the 
transmitted signal is known, its effect can be accounted for at the receiver. 
Thus correlative coding may be regarded as a practical means of achieving 
the theoretical maximum signaling rate of 2B, symbols per second in a 
bandwidth of Bo hertz, using realizable and perturbation-tolerant filters. 

In this section, we illustrate the basic idea of correlative coding by 
considering two specific examples: duobinary signaling and modified duo- 
binary signaling. Duobinary signaling employs a correlation span of one 
binary digit, whereas modified duobinary signaling employs a correlation 
span of two binary digits; the use of “duo” is intended to imply doubling 
of the transmission capacity of a straight binary system. 


DUOBINARY SIGNALING 


Consider a binary input sequence {b,} consisting of uncorrelated binary 
digits each having duration T, seconds, with symbol 1 represented by a 


3Correlative coding and partial response signaling are synonomous; both terms are 
used in the literature. The idea of correlative coding was originated by Lender 
(1963). For an overview on correlative coding, see Pasupathy (1977). 
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Figure 6.3 
Duobinary signaling scheme. 


pulse of amplitude +1 V, and symbol 0 by a pulse amplitude — 1 V. When 
this sequence is applied to a duobinary encoder, it is converted into a three- 
level output, namely, —2, 0, and +2 V. To produce this transformation, 
we may express the digit c, at the duobinary coder output as the sum of 
the present binary digit b, and its previous value b,_,, as shown by 


Ce = b; Te by-} (6.17) 


One of the effects of the transformation described by Eq. 6.17 is to change 
the input sequence {b,} of uncorrelated binary digits into a sequence {c,} 
of correlated digits. This correlation between the adjacent transmitted 
levels may be viewed as introducing intersymbol interference into the trans- 
mitted signal in an artificial manner. However, this intersymbol interfer- 
ence is under the designer’s control; this is the basis of correlative coding. 

Figure 6.3 depicts the block diagram of a duobinary encoder, including 
a band-limited channel assumed to be ideal. The binary sequence {b,} is 
first passed through a simple filter consisting of the parallel combination 
of a direct path and an ideal element producing a delay of T, seconds, 
where T, is the bit duration. For every unit impulse applied to the input 
of this filter, we get two unit impulses spaced T, seconds apart at the filter 
output. The output of this filter in response to the incoming binary sequence 
{b,} is then passed through the channel of transfer function H,( f) A 
continuous waveform is therefore produced at the channel output. The 
resulting waveform is sampled uniformly every T, seconds, thereby pro- 
ducing the duobinary encoded sequence {c,}. Note that the effect of the 
channel is included in this encoding operation. 

The cascade connection of the delay-line filter and the channel is called 
a duobinary conversion filter. In Fig. 6.3, we have enclosed this filter inside 
a dashed rectangle. The response of the filter may be characterized in terms 
of an overall transfer function H(f), which is evaluated next. 
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An ideal delay element, producing a delay of T, seconds, has the transfer 
function exp(—j2xfT,), so that the transfer function of the delay-line 
filter shown in Fig. 6.3 is 1 + exp(—j22fT,). Hence, the overall transfer 
function of this filter connected in cascade with the ideal channel H-(f) 
is 


H(f) = He(f)\[1 + exp(—j2xfT,)] 
H-(f)lexpUzfT,) + exp(—jxfT»)] exp(—jzfT») 


2H (f) cos(xfT,) exp(—jxf Ts) (6.18) 


For an ideal channel of bandwidth Bọ = 1/2T,, we have 


D AST, 


He(f) = t otherwise (6.19) 


Thus the overall frequency response has the form of a half-cycle cosine 
function, as shown by 


2 cos(a f Ts) exp(—jxfT,), © |f| < 1/2T, 
0, otherwise 


n { (6.20) 


for which the amplitude response and phase response are as shown in parts 
a and b of Fig. 6.4, respectively. An advantage of this frequency response 
is that it can be easily approximated in practice. 


arg [H(f)] 


IHJ) 


f 
ERNA 0 a 
2T, 2T, 
(a) 


Figure 6.4 
Frequency response of the duobinary conversion filter. (a) Amplitude response. 
(b) Phase response. 
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The corresponding value of the impulse response consists of two sinc 
pulses, time-displaced by T, seconds, as shown by (except for a scaling 
factor) 


sin(zt/T,) p sin[z(t — T,)/T>] 
ntl/T, Me Lj ie 

_ sin(zt/T,)  _sin(zt/T,) 
ntlT, a(t — T,)iT, 

T? sin(xt/T,) 


= “RUT, = 1) : (6.21) 


h(t) 


which is shown plotted in Fig. 6.5. We see that the overall impulse response 
h(t) has only two distinguishable values at the sampling instants. 

The original data {b,} may be detected from the duobinary-coded se- 
quence {c,} by subtracting the previous decoded binary digit from the 
currently received digit c, in accordance with Eq. 6.17. Specifically, letting 
b, represent the estimate of the original binary digit b, as conceived by the 
receiver at time t = kT,, we have 


A 


b, = (oj, = D (6.22) 


It is apparent that if c, is received without error and if the previous estimate 
b,- at time t = (k — 1)T, also corresponds to a correct decision, then 
the current estimate b, will be correct too. The technique of using a stored 
estimate of the previous symbol in the estimation of the current symbol is 
called decision feedback. 

We observe that the detection procedure as described here is essentially 
an inverse of the operation of the simple filter at the transmitter. However, 
a major drawback of this detection process is that once errors are made, 
they tend to propagate. This is because a decision on the current binary 


hit) 


Figure 6.5 
Impulse response of duobinary conversion filter. 
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digit b, depends on the correctness of the decision made on the previous 
binary digit b,_,. 

A practical means of avoiding this error propagation is to use precoding 
before the duobinary coding, as shown in Fig. 6.6. The precoding operation 
performed on the input binary sequence {b,} converts it into another binary 
sequence {a,} defined by 


an = by ® akı (6.23) 


where the symbol ® denotes modulo-two addition of the binary digits b, 
and a,_;. This addition is equivalent to the EXCLUSIVE OR operation. 
An EXCLUSIVE OR gate operates as follows. The output of a two-input 
EXCLUSIVE OR gate is a 1 if exactly one input is a 1; otherwise, the 
output remains a 0. The resulting precoder output {a,} is next applied to 
the duobinary coder, thereby producing the sequence {c,} that is related 
to {a,} as follows 


Ck = Ay + Ay_} (6.24) 


Note that unlike the linear operation of duobinary coding, precoding is a 
nonlinear operation. 

We assume that symbol 1 at the precoder output in Fig. 6.6 is represented 
by +1 V and symbol 0 by —1 V. Therefore, from Eqs. 6.23 and 6.24, we 
find that 

+2 V, if b, is represented by symbol 0 
Ck = s (6.25) 
0Y if b, is represented by symbol 1 


which is illustrated in Example 2. From Eq. 6.25 we deduce the following 
decision rule for constructing the decoded binary sequence {b,} at the 


Input 


Goo Module? 7 
{bp} | peak Duobinary N Output 
coder sequence 


H(f) Sample (cp) 


| 
| 
| 
| 
| 
| 
te 


Figure 6.6 
A precoded duobinary scheme. Details of the duobinary coder are given in Fig. 6.3. 
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(ce) = {leg |} Threshold {be} 
detector 
Figure 6.7 


Detector for recovering original binary sequence from the precoded duobinary 
coder output. 


receiver output: 
A i SUN: 
ma ee 0, n [ck] (6.26) 
symbol 1,  if|e| 51V 


According to Eq. 6.26, the detector (decoder) consists of a rectifier, the 
output of which is compared to a threshold of 1 V, and the original binary 
sequence {b;} is thereby detected. A block diagram of the detector is shown 
in Fig. 6.7. A useful feature of this detector is that no knowledge of any 
input sample other than the present one is required. Hence, error prop- 
agation cannot occur in the detector of Fig. 6.7. 

Moreover, we may note the following two points: 


1. In the absence of channel noise, the decoded sequence {6,} derived 
from Eq. 6.26 is exactly the same as the original binary sequence {b,} 
at the transmitter input. 

2. The use of Eq. 6.23 requires the addition of an extra bit to the precoded 
sequence {a,}. The decoded sequence {b} is invariant to the use of a 1 
or a Q for this extra bit. 


COC CCERS SOO SES EEEHOOHOOO OOOO OOOO TO OSE TESS OOS OE SOOSOOTSS OT SOTE OHSS OH OSOOEEESSSESSHETSHOSHSESEOSSESOSOOES OSSD OSODESSOOSEOOR 


EXAMPLE 2 


Consider the input binary sequence 0010110. To proceed with the precoding 
of this sequence, which involves feeding the precoder output back to the 
input, we add an extra bit to the precoder output. This extra bit is chosen 
arbitrarily as a bit 1. Hence, using Eq. 6.23, we find that the sequence {a,} 
at the precoder output is as shown in row 2 of Table 6.1. We assume that 
symbol 1 is represented by +1 V and symbol 0 by —1 V. Accordingly, 
the precoder output has the amplitudes shown in row 3. Finally, using Eq. 
6.24, we find that the duobinary coder output has the amplitudes given in 
row 4 of Table 6.1. 

To detect the original binary sequence, we apply the decision rule of 
Eq. 6.26, and so obtain the sequence given in row 5 of Table 6.1. This 
shows that, in the absence of noise, the original binary sequence is detected 
correctly. 


CoeeccccceoccooocesceseoesoooreoeelS 
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TABLE 6.1 

Input binary 0 0 1 0 1 1 0 
sequence {b,} 

Precoded binary 1 1 1 0 0 1 0 0 
sequence {a,} - 

Polar representation ql +1 tal = =]! sedl =i Sy 
of sequence {a,} 

Duobinary coder 2 2 Oe 0 0 =p 
output, {c4} 

Decoded binary 0 0 1 0 1 1 0 


sequence {b,} 
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x EXERCISE 3 Repeat the calculations of Table 6.1, assuming that the extra 


bit at the beginning of the precoded sequence {a,} i is a 0. Hence, show that 
the decoded sequence {by} i is unaffected by this change (compared to the 


fa initial bit used i in T ampie 2). 


l EXERCISE 4 The duobinary, ternary, and bipolar signaling techniques 


have one common feature: They all employ three amplitude levels. In sie: 
way does the duobinary technique differ from the other two? 


MODIFIED DUOBINARY SIGNALING 


In the duobinary signaling technique just described, the transfer function 
H( f), and consequently the power spectral density of the transmitted pulse, 
is nonzero at the origin. In some applications, this is an undesirable feature. 
We may correct for this drawback by using the modified duobinary signaling 
technique, which involves a correlation span of two binary digits. This is 
achieved by subtracting input binary digits spaced 2T, seconds apart. Spe- 
cifically, the output of the modified duobinary conversion filter is related 
to the sequence {a,} at its input as follows 


Ck = (ely, aa (6.27) 


Here, again, we find that a three-level signal is generated. If a, = +1 V, 
as assumed previously, c, takes on one of three values: 2, 0, and —2 V. 
Figure 6.8 depicts the complete block diagram of a modified duobinary 
encoder, incorporating an appropriate precoder and a band-limited channel 
assumed to be ideal. Here again the channel is included as an integral part 
of the encoding operation. The incoming binary sequence {b,} produces a 


-continuous waveform at the channel output. This waveform is therefore 
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Modified duobinary signaling scheme. 
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Figure 6.9 


Frequency response of modified duobinary conversion filter. (a) Amplitude 
response. (b) Phase response. 
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sampled uniformly every T, seconds to produce the modified duobinary 
encoded sequence {cp}. 

Let H(f) denote the overall transfer function of the modified duobinary 
conversion filter that consists of the cascade connection of the delay-line- 
filter and the channel; this filter is enclosed inside the second dashed rec- 
tangle in Fig. 6.8. Hence, we may write 


H(f) = Hc(f)[1 — exp(—j4zfT,)] (6.28) 
= 2jH(f) sin2zfT,) exp(—j2xfT,) 


where H(f) is defined in Eq. 6.19. We, therefore, have an overall fre- 
quency response in the form of a half-cycle sine function, as shown by 


2j sin(2afT,) exp(—j2zfT,), Ifl = 1/2T, 


0, elsewhere ic) 


HH) = | 


The corresponding amplitude response and phase response of the modified 
duobinary-coder are as shown in parts a and b of Fig. 6.9, respectively. 
Note that the phase response depicted in Fig. 6.9b does not include the 
constant 90°-phase shift due to the multiplying factor j in Eq. 6.29. A useful 
feature of the modified duobinary coder is the fact that its output has no 
dc component. This property is important since, in practice, many com- 
munication channels cannot transmit a dc component. 

The impulse response of the modified duobinary coder consists of two 
sinc pulses that are time-displaced by 27, seconds, as shown by (except 
for a scaling factor) 


Oe sin(xt/T,) _ sin[x(t — 2T;)/T;] 
ntlT, n(t cane 2T,)/T, 
_ sin(zt/T,)  _sin(zt/T,) 
ge T n(t — 27;)/T, 
DI sin(zt/T;) 
= EEL 6.30 
This impulse response is plotted in Fig. 6.10, which shows that it has three 
distinguishable levels at the sampling instants. 

To eliminate the possibility of error propagation in the modified duo- 
binary system, we use a precoding procedure similar to that used for the 
duobinary case. Specifically, prior to the generation of the modified duo- 
binary signal, a modulo-two logical addition is used on signals 2T, seconds 
apart, as shown by (see Fig. 6.8) 


an = b; ®© Ak-2 (6.31) 
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h (t) 


Figure 6.10 
Impulse response of the modified duobinary conversion filter. 


where {b,} is the input binary sequence and {a;} is the sequence at the 
precoder output. The sequence {a,} thus produced is then applied to the 
modified duobinary conversion filter. 

In Fig. 6.8, the output digit c, equals 0, +2, or —2V, assuming the use 
of a polar representation for the precoded sequence {a,}. Also we find that 
the decoded (detected) digit b, at the receiver output may be extracted 
from c, by disregarding the polarity of c,. Specifically, we may write 


7 PER 1 if le] >1V 


b, = (6.32) 


symbol 0 if |c,| < 


As with the duobinary signaling, we may note the following: 

1. In the absence of channel noise, the decoded binary sequence {b} is 
exactly the same as the original binary sequence {b,} at the transmitter 
input. 

2. The use of Eq. 6.31 requires the addition of two extra bits to the 
precoded sequence {a,}. The composition of the decoded sequence {b,} 
using Eq. 6.32 is invariant to the selection made for these two bits. 


EXERCISES Consider again the binary sequence 0010110 used to illustrate 
the operation of the duobinary signaling scheme in Example 2. Using this 
sequence as the input {b,}, calculate the following sequences for the mod- g 
ified duobinary signaling scheme of Fig. 6.8: 


(a) The sequence {a,} at the precoder output. 
(b) The polar representation of {a}. 
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- (c) The sequence {c,} at the modified duobinary conversion filter out- 
put, assuming the addition of bits 11 at the beginning of the precoded 
sequence {a;,}. 

(d) The decoded sequence {b,} at the receiver output. Compare this 
sequence with the original binary sequence {b}. 


EXERCISE6 Repeat the calculations of Exercise 5, assuming that the bits 


` added at the beginning of the precoded sequence {a,} are 00. Hence, show 


that the decoded sequence {6,} is unaffected by this choice of initial bits 


- for the sequence {a;,}. 
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6.6 BASEBAND TRANSMISSION OF M-ARY DATA 


In the baseband binary PAM system of Fig. 6.1, the output of the pulse 
generator consists of binary pulses, that is, pulses with one of two possible 
amplitude levels. On the other hand, in a baseband M-ary version of the 
system, the output of the pulse generator takes on one of M possible 
amplitude levels with M > 2; the digital waveform of a quaternary system 
(that is, M = 4) is illustrated in Fig. 5.12f. In an M-ary system, the 
information source emits a sequence of symbols from an alphabet that 
consists of M symbols. Each amplitude level at the pulse generator output 
corresponds to a distinct symbol, so that there are M distinct amplitude 
levels to be transmitted. 

Consider then an M-ary PAM system with a signal alphabet that contains 
M symbols, with the symbol duration denoted by T seconds. We refer to 
1/T as the signaling rate of the system, which is expressed in symbols per 
second or bauds. It is informative to relate the signaling rate of this system 
to that of an equivalent binary PAM system for which the value of M is 2 
and the bit duration is T, seconds. The binary PAM system transmits data 
at the rate of 1/T, bits per second. We also observe that in the case of a 
quaternary PAM system, for example, the four possible symbols may be 
identified with the dibits 00, 10, 11, and 01. We thus see that each symbol 
represents 2 bits of data and 1 baud is equal to 2 bits per second. We may 
generalize this result by stating that in an M-ary PAM system, 1 baud is 
equal to log, M bits per second, and the symbol duration T of the M-ary 
PAM system is related to the bit duration T, of the equivalent binary PAM 
system as follows: 


T = T, log,M (6.33) 


Therefore, in a given channel bandwidth, we find that by using an M-ary 
PAM system we are able to transmit data at a rate that is log} M faster 
than the corresponding binary PAM system. 

However, this improvement in bandwidth use is attained at a price. 
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Specifically, the transmitted power must be increased by a factor equal to 
M?/log.M, compared to a binary PAM system, if we are to realize the 
same performance in the presence of channel noise. 4 Also, system com- 
plexity is increased. 


A EXERCISE 7 An M-ary PAM system uses a raised cosine neta with 
roles. factor a. Show, that the signaling rate rate of the a is given by 


S R EE E A 
one a > opps ong DES 
pee b 


n where B is the channel bandwidth. 


eeann ennen 6.7 EYE PATTERN 


One way to study intersymbol interference in a PCM or data transmission 
system experimentally is to apply the received wave to the vertical deflec- 
tion plates of an oscilloscope and to apply a sawtooth wave at the trans- 
mitted symbol rate 1/T to the horizontal deflection plates. The waveforms 
in successive symbol intervals are thereby translated into one interval on 
the oscilloscope display, as illustrated in Fig. 6.11 for the case of a binary 
wave for which T = T,. The resulting display is called an eye pattern 
because of its resemblance to the human eye for binary waves. The interior 
region of the eye pattern is called the eye opening. 

An eye pattern provides a great deal of information about the perform- 
ance of the pertinent system, as described here (see Fig. 6.12): 


1. The width of the eye opening defines the time interval over which the 
received wave can be sampled without error from intersymbol inter- 
ference. It is apparent that the preferred time for sampling is the instant 
of time at which the eye is open widest. 


2. The sensitivity of the system to timing error is determined by the rate 
of closure of the eye as the sampling time is varied. 


3. The height of the eye opening, at a specified sampling time, defines the 
margin over channel noise. 


‘The performance of a data transmission system in the presence of channel noise is 
usually measured in terms of the average probability of symbol! error. When M is 
much larger than 2 and the average probability of symbol error is small compared 
to unity, an M-ary PAM system requires a transmitted power larger than in a 

Bn A r by a factor of M?/log-M. For a proof of this result, see Haykin (1988), 
pp. /8-80. 
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Binary 1 0 1 1 0 1 
data 


(a) 


(b) 


Figure 6.11 
(a) Distorted binary wave. (b) Eye pattern. 


When the effect of intersymbol interference is severe, traces from the upper 
portion of the eye pattern cross traces from the lower portion, with the 
result that the eye is completely closed. In such a situation, it is impossible 
to avoid errors due to the combined presence of intersymbol interference 
and channel noise in the system. 

In the case of an M-ary system, the eye pattern contains (M — 1) eye 
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Distortion of 
zero-crossings 


Time interval over 
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Figure 6.12 
Interpretation of the eye pattern. 
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openings stacked up vertically one on the other, where M is the number 
of discrete amplitude levels used to construct the transmitted signal. In a 
strictly linear system with truly random data, all these eye openings would 
be identical. In practice, however, it is often possible to discern asym- 
metries in the eye pattern, which are caused by nonlinearities in the trans- 
mission channel. 


-6.8 ADAPTIVE EQUALIZATION 


A study of baseband data transmission would be incomplete without some 
discussion of the equalization problem. By equalization we mean the pro- 
cess of correcting channel-induced signal distortion. Equalization is of par- 
amount importance in the high-speed transmission of digital data over a 
band-limited channel. In this final section of the chapter, we briefly discuss 
the need for equalization in the context of data transmission over a voice- 
grade telephone channel, which is essentially linear and is also character- 
ized by a limited bandwidth and a high signal-to-noise ratio. 

An efficient approach to high-speed data transmission over such a chan- 
nel involves the combined use of two basic forms of modulation: 


1. Discrete pulse-amplitude modulation (PAM): In this operation, the am- 
plitudes of successive pulses in a periodic train (acting as a carrier) are 
varied in a discrete fashion in accordance with the incoming data stream. 

2. Linear modulation: In this second operation, the amplitude or phase of 
a sinusoidal carrier is varied in accordance with the discrete PAM signal 
resulting from the first stage of modulation. The selection of a specific 
type of linear modulation is made with the aim of conserving channel 
bandwidth. Linear modulation schemes for data transmission are con- 
sidered in Sections 7.15 and 10.7. 


At the receiving end of the system, the received wave is demodulated, and 
then synchronously sampled and quantized. As a result of dispersion of 
the pulse shape by the channel, however, we find that the number of 
detectable amplitude levels is often limited by intersymbol interference 
rather than by additive noise. In principle, if the channel is known precisely, 
it is virtually always possible to make the intersymbol interference (at the 
sampling instants) arbitrarily small by using a suitable pair of transmitting 
and receiving filters, so as to control the overall pulse shape in the manner 
described in Section 6.4. The transmitting filter is placed directly before 
the modulator, whereas the receiving filter is placed directly after the 
demodulator. Thus, insofar as intersymbol interference is concerned, we 
may consider the data transmission as being essentially baseband. 
However, in a switched telephone network, we find that two factors 
contribute to the distribution of pulse distortion on different link connec- 
tions: (1) differences in the transmission characteristics of the individual 
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links that may be switched together, and (2) differences in the number of 
links in a connection. The result is that the telephone channel is random 
in the sense of being one of an ensemble of possible channels. Conse- 
quently, the use of a fixed pair of transmitting and receiving filters designed 
on the basis of average channel characteristics may not adequately reduce 
intersymbol interference. To realize the full transmission capability of a 
telephone channel, there is need for adaptive equalization. An equalizer 
is a filter that compensates for the dispersive effects of a channel. The 
process of equalization is said to be adaptive when the equalizer is capable 
of adjusting its coefficients continuously during the transmission of data; 
it does so by operating on the received signal (channel output) in accord- 
ance with some algorithm. 

Among the philosophies for adaptive equalization of data transmission 
systems, we have prechannel equalization at the transmitter and postchannel 
equalization at the receiver. Because the first approach requires a feedback 
channel, we consider only adaptive equalization at the receiving end of the 
system. This equalization can be achieved, prior to data transmission, by 
training the filter with the guidance of a suitable training sequence trans- 
mitted through the channel so as to adjust the filter parameters to optimum 
values. The typical telephone channel changes little during an average data 
call, so that precall equalization with a training sequence is sufficient in 
most cases encountered in practice. The equalizer is positioned after the 
receiving filter in the receiver. 

Figure 6.13 shows a popular structure used to design adaptive equalizers. 
The structure is a tapped-delay-line filter that consists of a set of delay 
elements, a set of multipliers connected to the delay-line taps, a corre- 
sponding set of adjustable tap weights, and a summer for adding the mul- 
tiplier outputs. Let the sequence {x(nT)}, appearing at the output of the 
receiving filter, be applied to the input of this tapped-delay-line filter, 
producing the output (see Fig. 6.13). 


y(nT) = > w,x(nT — iT) (6.34) 


i=0 


where w; is the weight at the ith tap, and M is the total number of taps. 
These M tap weights constitute the adaptive filter coefficients. The tap 
spacing is chosen equal to the symbol duration T of the transmitted signal 
or the reciprocal of the signaling rate. 

The adaptation of the filter may be achieved by proceeding as follows: 


1. A known sequence {d(nT)} is transmitted, and in the receiver the re- 
sulting response sequence {y(nT)} is obtained by measuring the filter 
output at the sampling instants. 

2. Viewing the known transmitted sequence {d(nT)} as the desired re- 
sponse, the differences between it and the response sequence {y(nT)} 
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Figure 6.13 
Elements of an adaptive filter. 


is computed. This difference is called the error sequence, denoted by 
{e(nT)}; thus, 


e(nT) = d(nT) — y(nT), =n=0,1,...N — 1“ (6.35) 


where N is the total length of the sequence. 


3. The error sequence {e(nT)} is used to estimate the direction in which 
the weights {w,} of the filter are changed so as to make them approach 
their optimum settings {w,,}. 


We assume that all sequences (signals) of interest are real valued. A cri- 
terion appropriate for optimization is the total error energy defined by 


Nt 
C= D e*(nT) (6.36) 
n=0 
The optimum values of the tap weights, namely, Woo, Wors - - - Wo,m_1 result 


when the total error energy & is minimized. 

The solution to this optimization problem may be developed in the form 
of an algorithm that adjusts the tap weights of the filter in a recursive 
manner, which means that the tapped-delay-line filter assumes a time- 
varying form. In particular, the present estimate of each tap weight is 
updated by incrementing it by a correction term proportional to the error 
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signal at that time. Thus, starting from some arbitrary initial condition, the 
algorithm learns (about the operating channel conditions) from the incom- 
ing data, sample by sample, and thereby automatically adjusts the tap 
weights toward the optimum solution. 

A simple and yet effective solution to this adaptation procedure is pro- 
vided by the least-mean-square (LMS) algorithm.* According to the LMS 
algorithm, the tap weights are adapted as follows: 


W(nT + T) = W(nT) + we(nT)x(nT — iT) (6.37) 


where i = 0,1,...,M — 1, and W,(nT) is the present estimate of the 
optimum weight w, for tap i at time nT, and W,(nT + T) is the updated 
estimate. The parameter u in Eq. 6.37 is called the adaptation constant. In 
particular, it controls the amount of correction applied to the old estimate 
W;(nT) to produce the updated estimate w,(nT + T). In addition to the 
parameter „u, the correction depends on the filter input x(nT — iT) and 
the error signal e(nT), both measured at time nT. Thus, by a proper choice 
of the adaptation constant x, the use of the recursive equation (6.37) helps 
the adjustment of the tap weights move toward their optimum settings in 
a step-by-step fashion. Typically, for the starting condition, all the tap 
weights of the equalizer are set equal to zero. 

The LMS algorithm requires knowledge of the desired response d(nT) 
and the filter response y(T) to form the error signal e(nT) in accordance 
with Eq. 6.35. For y(nT), we may use Eq. 6.34 with #({nT) substituted 
for w;. However, by the very nature of data communications, the desired 
response (providing a frame of reference for the adaptation process) orig- 
inates at the channel input, which is separated physically from the receiver 
where the adaptive equalization is preformed. There are two methods in 
which a replica of the desired response d(nT) may be obtained, as illus- 
trated in Fig. 6.14. These two methods and their applicability are described 
in the following paragraphs. 

In the first method, a replica of the desired response is stored in the 
receiver. Naturally, the generator of this stored reference has to be syn- 
chronized with the known transmitted sequence. The use of a stored ref- 
erence is well suited for the initial training of the equalizer. This operation 
of the equalizer corresponds to position 1 of the switch in Fig. 6.14. (In 
Section 8.9 we describe a pseudo-random sequence Known as a linear 
maximal sequence that may be used for this purpose.) 

In the second method, the output from a decision device in the receiver 
is used. Under normal operating conditions, the decisions made by the 
receiver are correct with high probability. This means that the error esti- 


5For a detailed discussion of the LMS and other adaptive filtering algorithms, see 
the following references: Haykin (1986), and Widrow and Stearns (1985). 
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Figure 6.14 

Illustrating the two modes of operation of an adaptive equalizer: Position 1 of the 
switch corresponds to the training mode. Position 2 corresponds to the 
decision-directed mode. 


mates thus obtained are correct most of the time, thereby permitting the 
adaptive equalizer to operate satisfactorily. This second method of oper- 
ation is referred to as the decision-directed mode of the adaptive equalizer; 
it corresponds to position 2 of the switch in Fig. 6.14. It is well suited for 
tracking relatively slow variations in channel characteristics during the course 
of transmission. 

The adaptive equalizer depicted in Fig. 6.14 represents a closed-loop 
feedback system, irrespective of its mode of operation. As such, there is a 
tendency for the adaptive equalizer to become unstable. To ensure stability, 
care has to be exercised in the value assigned to the adaptation constant 
4 in the time update of Eq. 6.37. On the one hand, x must be large enough 
to ensure a reasonably fast rate of convergence of the LMS algorithm. On 
the other hand, it must be small enough to make it possible for the LMS 
algorithm to track slow statistical variations in the channel. 
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PROBLEMS 
P6.3 Ideal Solution 
Problem 1 The pulse shape p(t) of a baseband binary PAM system is 


defined by 
(t) = sinc eh 
pit) = T, 


where T, is the bit duration of the input binary data. The amplitude levels 
at the pulse generator output are +1 V or —1 V, depending on whether 
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the binary symbol at the input is 1 or 0, respectively. Sketch the waveform 
at the output of the receiving filter in response to the input data 001101001. 


P6.4 Raised Cosine Spectrum 


Problem 2 An analog signal is sampled, quantized, and encoded into a 
binary PCM wave. The specifications of the PCM system include the fol- 
lowing: i 


Sampling rate = 8 kHz 
Number of representation levels = 64 


The PCM wave is transmitted over a baseband channel using discrete pulse- 
amplitude modulation. Determine the minimum bandwidth required for 
transmitting the PCM wave if each pulse is allowed to take on the following 
number of amplitude levels: 


(a) 2 
(b) 4 
(c) 8 


Problem 3 The raised cosine pulse spectrum for a rolloff factor of unity 
is given by 
l Tf ) 
— cos? — ], 0s |f| <2B 
P(f) = 42Bo ( Bo fl A 
0, 2B, < |f| 


Show that the time response p(t), the inverse Fourier transform of P(f), 
iS 


_ sinc(4 Bo) 
PY) = + Te RA 


Problem 4 A computer puts out binary data at the rate of 56 kilobits per 
second. The computer output is transmitted using a baseband binary PAM 
system that is designed to have a raised cosine pulse spectrum. Determine 
the transmission bandwidth required for each of the following rolloff fac- 
tors: 


(a) a = 0.25 
(b) a = 0.5 
(c) a = 0.75 
(d) a = 1.0 
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Problem 5 A binary PAM wave is to be transmitted over a low-pass 
channel with an absolute maximum bandwidth of 75 kHz. The bit duration 
is 10 us. Find a raised cosine spectrum that satisfies these requirements. 


P6.5 Correlative Coding 


Problem 6 The binary data 001101001 is applied to the input of a duo- 
binary system. 


(a) Construct the duobinary coder output and corresponding receiver 
output, without a precoder. 

(b) Suppose that owing to error during transmission, the level at the 
receiver input produced by the second input digit is reduced to zero. 
Construct the new receiver output. 


Problem 7 Repeat Problem 6, assuming the use of a precoder in the 
transmitter. 


Problem 8 The binary data 011100101 is applied to the input of a modi- 
fied duobinary system. 


(a) Construct the modified duobinary coder output and corresponding 
receiver output, without a precoder. 

(b) Suppose that owing to error during transmission, the level produced 
by the third input digit is zero. Construct the new receiver output. 


Problem 9 Repeat Problem 8, assuming the use of a precoder in the 
transmitter. 


Problem 10 Using conventional analog filter design methods, it is difficult 
to approximate the frequency response of the modified duobinary system 
defined by Eq. 6.29. To get around this problem, we may use the arrange- 
ment shown in Fig. P6.1. Justify the validity of this scheme. 


P6.6 Baseband Transmission of M-ary Data 


Problem 11 Repeat Problem 4, given that each set of three successive 
binary digits in the computer output are coded into one of eight possible 


Input 
binary Output 
sequence sequence 

{by } Duobinary {cy } 
conversion 
filter 


Figure P6.1 
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amplitude levels, and the resulting signal is transmitted by using an 8-level 
PAM system designed to have a raised cosine pulse spectrum. 


Problem 12 An analog signal is sampled, quantized, and encoded into a 
binary PCM wave. The number of representation levels used is 128. A 
synchronizing pulse is added at the end of each code word representing a 
sample of the analog signal. The resulting PCM wave is transmitted over 
a channel of bandwidth 12 kHz using a quaternary PAM system with a 
raised cosine pulse spectrum. The rolloff factor is unity. 


(a) Find the rate (in bits per second) at which information is transmitted 
through the channel. 

(b) Find the rate at which the analog signal is sampled. What is the 
maximum possible value for the highest frequency component of the 
analog signal? 


P6.7 Eye Pattern 


Problem 13 A binary wave using polar signaling is generated by repre- 
senting symbol 1 by a pulse of amplitude +1 V and symbol 0 by a pulse 
of amplitude — 1 V; in both cases the pulse duration equals the bit duration. 
This signal is applied to a low-pass RC filter with transfer function: 


1 


a aT 


Construct the eye pattern for the filter output for the following sequences: 


(a) Alternating 1’s and 0’s. 

(b) A long sequence of 1’s followed by a long sequence of 0’s. 

(c) A long sequence of 1’s followed by a single 0 and then a long 
sequence of 1’s. 


Assume a bit rate of 2f, bits per second. 


Problem14 The binary sequence 011010 is transmitted through a channel 
having a raised cosine characteristic with a rolloff factor of unity. Assume 
the use of polar signaling, with symbols 1 and 0 represented by +1 and 
—1 V, respectively. 


(a) Construct, to scale, the received wave, and indicate the best sam- 
pling times for regeneration. 

(b) Construct the eye pattern for this received wave and show that it 
is completely open. 

(c) Determine the zero crossings of the received wave. 


SO CHAPTER SEVEN 


Os cinarity, the transmission of a message signal (be it in analog or 
digital form) over a band-pass communication channel (e.g., telephone 
line, satellite channel) requires a shift of the range of frequencies 
contained in the signal into other frequency ranges suitable for 
transmission, and a corresponding shift back to the original frequency 
range after reception. For example, a radio system must operate with 
frequencies of 30 kHz and upward, whereas the message signal usually 
contains frequencies in the audio frequency range, so some form of 
frequency-band shifting must be used for the system to operate 

- satisfactorily. A shift of the range of frequencies in a signal is 
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accomplished by using modulation, defined as the process by which some 
characteristic of a carrier is varied in accordance with a modulating wave.' 
The message signal is referred to as the modulating wave, and the result 
of the modulation process is referred to as the modulated wave. At the 
receiving end of the communication system, we usually require the message 
signal to be recovered. This is accomplished by using a process known as 
demodulation, or detection, which is the inverse of the modulation process. 

In this chapter we study modulation techniques for both analog and 
digital forms of message (information-bearing) signals. The chapter is a 
long one, which is the result of integrating a variety of modulation tech- 
niques, side-by-side. The chapter is organized as follows: 


1. In Sections 7.1 through 7.8, we study the various types of amplitude 
modulation that constitute the first family of analog modulation tech- 
niques. In amplitude modulation the amplitude of a sinusoidal carrier 
wave is varied in accordance with the information-bearing signal. The 
applications of amplitude modulation in broadcasting are considered in 
Section 7.9. 

2. In Sections 7.10 through 7.13, we study the second family of analog 
modulation techniques known collectively as angle modulation. In this 
method of modulation the phase or frequency of a sinusoidal carrier 
wave is varied in accordance with the information-bearing signal. The 
application of frequency modulation, an important type of angle mod- 
ulation, in broadcasting is considered in Section 7.14. 

3. Finally, in Section 7.15 we describe digital modulation techniques. The 
discussion is completed in Section 7.16 with a description of digital 
satellite communications. 


seccsccccsccsesee 21 AMPLITUDE MODULATION 


Consider a sinusoidal carrier wave c(t) defined by 
c(t) = A, cos(27f,t) (7.1) 


where the peak value A, is called the carrier amplitude and f, is called the 
carrier frequency. For convenience, we have assumed that the phase of the 
carrier wave is zero in Eq. 7.1. We are justified in making this assumption 
since the carrier source is always independent of the message source. Let 
m(t) denote the baseband signal that carries specification of the message. 
From here on, we refer to m(t) as the message signal. Amplitude modulation 
is defined as a process in which the amplitude of the carrier wave c(t) is 
varied linearly with the message signal m(t). This definition is general enough 


‘IEEE Standard Dictionary of Electrical and Electronics Terms, p. 351 (Wiley- 
Interscience, 1972). 
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to permit different interpretations of the linearity. Correspondingly, am- 
plitude modulation may take on different forms, depending on the fre- 
quency content of the modulated wave. In the following section we consider 
the standard form of amplitude modulation. 


TIME-DOMAIN DESCRIPTION 
The standard form of an amplitude-modulated (AM) wave is defined by 


s(t) = A[1 + k,m(t)] cos(2zf.t) (7.2) 


where k, is a constant called the amplitude sensitivity of the modulator. 
The modulated wave so defined is said to be a “standard? AM wave, 
because (as we will see presently) its frequency content is fully represen- 
tative of amplitude modulation. 

The amplitude of the time function multiplying cos(2zf,t) in Eq. 7.2 is 
called the envelope of the AM wave s(t). Using a(t) to denote this envelope, 
we may thus write 


a(t) = Aj + k.m(t)| (7.3) 


Two cases of particular interest arise, depending on the magnitude of 
k,m(t), compared to unity. For case 1, we have 


|km(t)| <1, for allt (7.4) 


Under this condition, the term 1 + k,m(t) is always nonnegative. We may 
therefore simplify the expression for the envelope of the AM wave by 
writing 


a(t) = A,[1 + k,m(t)], for all t (7.5) 
For case 2, on the other hand, we have 
|\kam(Ð| > 1, for some t (7.6) 


Under this condition, we must use Eq. 7.3 for evaluating the envelope of 
the AM wave. 

The maximum absolute value of k,m/(t) multiplied by 100 is referred to 
as the percentage modulation. Accordingly, case 1 corresponds to a per- 
centage modulation less than or equal to 100%, whereas case 2 corresponds 
to a percentage modulation in excess of 100%. 

The waveforms of Fig. 7.1 illustrate the amplitude modulation process. 
Part a of the figure depicts the waveform of a message signal m(t). Part b 
of the figure depicts an AM wave produced by this message signal for a 
value of k, for which the percentage modulation is 66.7% (i.e., case 1). 
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ta Message signal m(t). (b) AM wave s(t) for |k,m(t)| < 1 for allt. (c) AM wave sit) 
for |k,m(t)| > 1 some of the time. 


On the other hand, the AM wave shown in part c of the figure corresponds 
to a value of k, for which the percentage modulation is 166.7% (i.e., case 
2). Comparing the waveforms of these two AM waves with that of the 
message signal, we draw an important conclusion. Specifically, the envelope 
of the AM wave has a waveform that bears a one-to-one correspondence 
with that of the message signal if and only if the percentage modulation is 
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less than or equal to 100%. This correspondence is destroyed if the per- 
centage modulation exceeds 100%. In the latter case, the modulated wave 
is said to suffer from envelope distortion, and the wave itself is said to be 
overmodulated. 

The complexity of the detector (i.e., the demodulation circuit used to 
recover the message signal from the incoming AM wave at the receiver) 
is greatly simplified if the transmitter is designed to produce an envelope 
a(t) that has the same shape as the message signal m(t). For this require- 
ment to be realized, we must satisfy two conditions: 


1. The percentage modulation is less than 100%, so as to avoid envelope 
distortion. 

2. The message bandwidth, W, is small compared to the carrier frequency 
fe, so that the envelope a(t) may be visualized satisfactorily. Here, it 
is assumed that the spectral content of the message signal is negligible 
for frequencies outside the interval -W < f < W. 


"EXERCISE 1 Demonstrate that the percentage modulation for the AM 
- wave shown in Fig. 7.1b equals 66.7%, whereas for ae AM wave cain 
in Fig. 7.1c it scl 166.7%. ie 


FREQUENCY-DOMAIN DESCRIPTION 


Equation 7.2 defines the standard AM wave s(t) as a function of time. To 
develop the frequency description of this AM wave, we take the Fourier 
transform of both sides of Eq. 7.2. Let S(f) denote the Fourier transform 
of s(t), and M(f) denote the Fourier transform of the message signal m(t); 
we refer to M(f) as the message spectrum. Accordingly, using the Fourier 
transform of the cosine function A, cos(2zf,t) and the frequency-shifting 
property of the Fourier transform (see Sections 2.3 and 2.5), we may write 


SA) = FEG - f) + oF + FO 
+ EAs IMC - f) + ME + fo 17) 


Let the message signal m(t) be band-limited to the interval -W < f < W, 
as in Fig. 7.2a. The shape of the spectrum shown in this figure is intended 
for the purpose of illustration only. We find from Eq. 7.7 that the spectrum 
S(f) of the AM wave is as shown in Fig. 7.2b for the case when f. > W. 
This spectrum consists of two delta functions weighted by the factor A,/2 
and occurring at +f, and two versions of the baseband spectrum translated 
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Figure 7.2 
(a) Spectrum of messages signal. (b) Spectrum of AM wave. 


in frequency by +f, and scaled in amplitude by k,A,/2. The spectrum of 
Fig. 7.2b, may be described as follows: 


1. For positive frequencies, the portion of the spectrum of the modulated 
wave lying above the carrier frequency f, is called the upper sideband, 
whereas the symmetric portion below f, is called the lower sideband. 
For negative frequencies, the image of the upper sideband is represented 
by the portion of the spectrum below — f, and the image of the lower 
sideband by the portion above — f.. The condition f, > W ensures that 
the sidebands do not overlap. Otherwise, the modulated wave exhibits 
spectral overlap and, therefore, frequency distortion. 

2. For positive frequencies, the highest frequency component of the AM 
wave is fe + W, and the lowest frequency component is fe — W. The 
difference between these two frequencies defines the transmission band- 
width B for an AM wave, which is exactly twice the message bandwidth 
W; that is, i 

B = 2W (7.8) 


The spectrum of the AM wave as depicted in Fig. 7.2b is full in that the 
carrier, the upper sideband, and the lower sideband are all completely 
represented. It is for this reason that we treat this form of amplitude 
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modulation as the “standard” against which other forms of amplitude mod- 
ulation are compared. 
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EXAMPLE 1 SINGLE-TONE MODULATION 


Consider a modulating wave m(t) that consists of a single tone or frequency } 
component, that is, 


m(t) = Am cos(27f »t) (7.9) 7 


where A,, is the amplitude of the modulating wave and f,, is its frequency ; 

(see Fig. 7.3a). The sinusoidal earrier wave c(t) has amplitude A, and } 

frequency f. (see Fig. 7.3b). The requirement is to evaluate the time- } 

domain and frequency-domain characteristics of the resulting AM wave. ; 
The AM wave is described by 


s(t) = A.[1 + u cos(2zf,,t)] cos(27f,t) (7.10) 
where 
U= ki,An (7.11) 


The dimensionless constant u is the modulation factor, or the percentage 
modulation when it is expressed numerically as a percentage. To avoid 
envelope distortion due to overmodulation, the modulation factor y must 
be kept below unity. 
Figure 7.3c is a sketch of s(t) for u less than unity. Let A max and A min 
denote the maximum and minimum values of the envelope of the modu- 
lated wave. Then, from Eq. 7.10 we get 


Anas = A(1 at 4) 
Ans A(1 si u) 


That is, 


Ak z A min 


l2 
A SE Ama ( ) 


Lo 


Expressing the product of the two cosines in Eq. 7.10 as the sum of two } 
sinusoidal waves, one having frequency fe + fm and the other having } 
frequency fe — fm, we get 3 


s(t) = A, cos(2zf,t) + uA, cos[2z(f. + fm)t] ; 
+ 4A, cos[2n(fe — fm)tl (7.13) È 
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Figure 7.3 
The time-domain and frequency-domain characteristics of different modulated 
waves produced by a single tone. 


The Fourier transform of s(t) is therefore 


Sf) = AU =f.) + OG +a 
ar 4uA [O(f z fe a tie T o(f a ie ar fadl 
F aH A [o(f z Tc ap iF) ar ò(f ar fe >g fm)] (7.14) 


Thus the spectrum of an AM wave, for the special case of sinusoidal 
modulation, consists of delta functions at +f., fe + fa, and — fc ./as 
in Fig. 7.3c. 
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Figure 7.4 
Variations of carrier power and total sideband power with percentage modulation. 
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In practice, the AM wave s(t) is a voltage or current wave. In either 
case, the average power delivered to a 1-ohm load resistor by s(t) is com- 
prised of three components: 


Carrier power = 3A? 


Upper side-frequency power = 3y2A?2 


Lower side-frequency power = §yA? 


The ratio of the total sideband power to the total power in the modulated 
wave is therefore equal to y?/(2 + u’), which depends only on the mod- 
ulation factor u. If uw = 1, that is, 100% modulation is used, the total 
power in the two side-frequencies of the resulting AM wave is only one 
third of the total power in the modulated wave. 

Figure 7.4 shows the percentage of total power in both side-frequencies 
and in the carrier plotted versus the percentage modulation. Note that 
when the percentage modulation is less than 20%, the power in one side- 
frequency is less than 1% of the total power in the AM wave. 
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GENERATION OF AM WAVES 


Having familiarized ourselves with the characteristics of a standard AM 
wave, we may go on to describe devices for its generation. Specifically, we 
describe the square-law modulator and the switching modulator, both of 
which require the use of a nonlinear element for their implementation. 
These two devices are well-suited for low-power modulation purposes. 
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Square-Law Modulator A square-law modulator requires three features: 
a means of summing the carrier and modulating waves, a nonlinear ele- 
ment, and a band-pass filter for extracting the desired modulation products. 
These features of the modulator are illustrated in Fig. 7.5. Semiconductor 
diodes and transistors are the most common nonlinear devices used for 
implementing square-law modulators. The filtering requirement is usually 
satisfied by using a single- or double-tuned filter. 

When a nonlinear element such as a diode is suitably biased and operated 
in a restricted portion of its characteristic curve, that is, the signal applied 
to the diode is relatively weak, we find that the transfer characteristic of 
the diode-load resistor combination can be represented closely by a square 
law: 


v(t) = a,v,(t) + azv;{(t) (7.15) 


where a, and a, are constants. The input voltage v,(t) consists of the carrier 
wave plus the modulating wave, that is, 


v(t) = A, cos(2zf,t) + m(t) (7.16) 


Therefore, substituting Eq. 7.16 in 7.15, the resulting voltage developed 
across the primary winding of the output transformer is given by 


v(t) = a,A, E + = m(o cos(27 f.t) 


AM wave 


+ aym(t) + am?(t) + a,A2 cos?(2n f.t) (7.17) 
\ ee 


Unwanted terms 
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Figure 7.5 
Square-law modulator. 
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The first term in Eq. 7.17 is the desired AM wave with amplitude sensitivity 
ka = 2a,/a,. The remaining three terms are unwanted terms; they are 
removed by appropriate filtering. 


Switching Modulator A switching modulator is shown in Fig. 7.6a, where 
it is assumed that the carrier wave c(t) applied to the diode is large in 
amplitude, so that it swings right across the characteristic curve of the 
diode. We assume that the diode acts as an ideal switch; that is, it presents 
zero impedance when it is forward-biased [corresponding to c(t) > 0] and 
infinite impedance when it is reverse-biased [corresponding to c(t) < 0). 


c(t) = A, cos (27f, t) 


v(t) 


(a) 


Up 


Slope = 1 


(b) 


Figure 7.6 ane oe : 
Switching modulator. (a) Circuit diagram. (b) Idealized input-output relation. 
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We may thus approximate the transfer characteristic of the diode—load 
resistor combination by a piecewise-linear characteristic, as shown in Fig. 
7.6b. Accordingly, for an input voltage v,(t) given by 


v(t) = A, cos(2zf,t) + m(t) (7.18) 


where |m(t)| < A., the resulting load voltage v,(t) is 


Oe ae ae a (7.19) 


That is, the load voltage v,(t) varies periodically between the values v(t) 
and zero at a rate equal to the carrier frequency f,. In this way, by assuming 
a modulating wave that is weak compared with the carrier wave, we have 
effectively replaced the nonlinear behavior of the diode by an approxi- 
mately equivalent linear time-varying operation. 

We may express Eq. 7.19 mathematically as 


v(t) = [A cos(2nf.t) + m(A)]g,(0) (7.20) 
where g,(t) is a periodic pulse train of duty cycle equal to one half and 


period To = 1/f,, as in Fig. 7.7. Representing this g,(t) by its Fourier 
series, we have 


TEE pe 
A ea me ee rem: D 
IE 
=i + = cos(2zf,t) + odd harmonic components (7.21) 


Therefore substituting Eq. 7.21 in 7.20, we find that the load voltage v,(t) 
is as follows: 


A, 4 
v(t) = J |: a- = m(o | cos(2zf,t) + unwanted terms (7.22) 


-To 


Figure 7.7 
Periodic pulse train. 
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The first term of Eq. 7.22 is the desired AM wave with amplitude sensitivity 
ka = 4/xA,. The unwanted terms are removed from the load voltage v(t) 
by means of a band-pass filter. 


_ EXERCISE 3 Show that removal of the unwanted terms in Eq. 7.22 is 
_ accomplished if the band-pass filter satisfies the following specifications: 


Midband frequency = f, 
Bandwidth = 2W 
Te > QW 78 


DETECTION OF AM WAVES 


The process of detection or demodulation provides a means of recovering 
the message signal from an incoming modulated wave. In effect, detection 
is the inverse of modulation. In the sequel, we describe two devices for 
the detection of AM waves, namely, the square-law detector and the en- 
velope detector. 


Square-Law Detector A square-law detector is essentially obtained by us- 
ing a square-law modulator for the purpose of detection. Consider Eq. 
7.15 defining the transfer characteristic of a nonlinear device, which is 
reproduced here for convenience: 


v(t) = ayv,(t) + awi(t) (7.23) 


where v,(t) and v,(t) are the input and output voltages, respectively, and 
a, and a, are constants. When such a device is used for the demodulation 
of an AM wave, we have for the input 


v(t) = A,{1 + k,m(t)] cos(2zf,t) (7.24) 
_ Therefore, substituting Eq. 7.24 in 7.23, we get 


v(t) = a,A,[1 + k,m(t)] cos(2zf,t) 
+ $a,A2[1 + 2k,m(t) + k2m?*(t)][1 + cos(4zf,t)] (7.25) 


The desired signal, namely, a,A2k,m(t), is due to the a,v? (t) term—hence, 
the description “‘square-law detector.” This component can be extracted 
by means of a low-pass filter. This is not the only contribution within the 
baseband spectrum, however, because the term 3a,A2km’*(t) will give rise 
to a plurality of similar frequency components. The ratio of wanted signal 
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to distortion is equal to 2/k,m(t). To make this ratio large we limit the 
percentage modulation, that is, we choose |k,m(t)| small compared with 
unity for all t. We conclude therefore that distortionless recovery of the 
baseband signal m(t) is possible only if the applied AM wave is weak (so 
as to justify the use of a square-law input-output relation as in Eq. 7.23) 
and if the percentage modulation is very small. 


Envelope Detector An envelope detector is a simple and yet highly effec- 
tive device that is well-suited for the demodulation of a narrow-band AM 
wave (i.e., the carrier frequency is large compared with the message band- 
width), for which the percentage modulation is less than 100%. Ideally, 
an envelope detector produces an output signal that follows the envelope 
of the input signal waveform exactly; hence, the name. Some version of 
this circuit is used in almost all commercial AM radio receivers. 

Figure 7.8a shows the circuit diagram of an envelope detector that 
consists of a diode and a resistor-capacitor filter. The operation of this 
envelope detector is as follows. On the positive half-cycle of the input 
signal, the diode is forward-biased and the capacitor C charges up rapidly 
to the peak value of the input signal. When the input signal falls below 
this value, the diode becomes reverse-biased and the capacitor C discharges 
slowly through the load resistor R;. The discharging process continues until 
the next positive half-cycle. When the input signal becomes greater than 
the voltage across the capacitor, the diode conducts again and the process 
is repeated. We assume that the diode is ideal, presenting zero impedance 
to current flow in the forward-biased region, and infinite impedance in the 
reverse-biased region. We further assume that the AM wave applied to 
the envelope detector is supplied by a voltage source of internal impedance 
R,. The charging time constant R,C must be short compared with the carrier 
period 1/f,, that is, 


RC < 7 (7.26) 


Hence, the capacitor C charges rapidly and thereby follows the applied 
voltage up to the positive peak when the diode is conducting. On the other 
hand, the discharging time constant R,C must be long enough to ensure 
that the capacitor discharges slowly through the load resistor R, between 
positive peaks of the carrier wave, but not so long that the capacitor voltage 
will not discharge at the maximum rate of change of the modulating wave, 
that is, 


1 1 
RC <= (7.21) 


io} 
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S) ü R, = Output 
A 
HAVANT TATE l 


(c) 


Figure 7.8 
Envelope detector. (a) Circuit diagram. (b) AM wave input. (c) Envelope detector 


output. 


where W is the message bandwidth. The result is that the capacitor voltage 
or detector output is very nearly the same as the envelope of the AM wave, 
as illustrated in Figs. 7.8b and c. The detector output usually has a small 
ripple (not shown in Fig. 7.8c) at the carrier frequency; this ripple is easily 
removed by low-pass filtering. 


seccccesoorscoorele 
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7.2 DOUBLE-SIDEBAND SUPPRESSED-CARRIER MODULATION 


In the standard form of amplitude modulation, the carrier wave c(t) is 
completely independent of the message signal m(t), which means that the 
transmission of the carrier wave represents a waste of power. This points 
to a shortcoming of amplitude modulation; namely, that only a fraction of 
the total transmitted power is affected by m(t). To overcome this short- 
coming, we may suppress the carrier component from the modulated wave, 
resulting in double-sideband suppressed carrier modulation. Thus, by sup- 
pressing the carrier, we obtain a modulated wave that is proportional to 
the product of the carrier wave and the message signal. 


TIME-DOMAIN DESCRIPTION 


To describe a double-sideband suppressed-carrier (DSBSC) modulated wave 
as a function of time, we write 

s(t) = c(t)m(t) 
A, cos(27f,t)m(t) (7.28) 


This modulated wave undergoes a phase reversal whenever the message 
signal m(t) crosses zero, as illustrated in Fig. 7.9; part a of the figure depicts 
the waveform of a message signal, and part b depicts the corresponding 
DSBSC-modulated wave. Accordingly, unlike amplitude modulation, the 
envelope of a DSBSC modulated wave is different from the message signal. 


EXERCISE 4 Sketch the envelope of the DSBSC modulated wave shown 
in Fig. 7.95 and compare it to the message signal depicted in Fig. 7.9a. 


FREQUENCY-DOMAIN DESCRIPTION 


The suppression of the carrier from the modulated wave of Eq. 7.28 is 
well-appreciated by examining its spectrum. Specifically, by taking the 
Fourier transform of both sides of Eq. 7.28, we get 


S(f) = 3A{[M(f - f) + MG + fol (7.29) 


where, as before, S(f) is the Fourier transform of the modulated wave 
s(t), and M(f) is the Fourier transform of the message signal m(t). When 
the message signal m(t) is limited to the interval -W < f < W, 
as in Fig. 7.10a, we find that the spectrum S(f) is as illustrated in part b 
of the figure. Except for a change in scale factor, the modulation process 
simply translates the spectrum of the baseband signal by +f.. Of course, 
the transmission bandwidth required by DSBSC modulation is the same 
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m(t) 


(a) 


s(t) 


Phase reversal 


Figure 7.9 
(a) Message signal. (b) DSBSC-modulated wave s(t). 


M(f) 


M(0) 


=j 0 i f 
2w (b) 2W 


Figure 7.10 
(a) Spectrum of message signal. (b) Spectrum of DSBSC modulated wave. 
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as that for standard amplitude modulation, namely, 2W. However, com- 
paring the spectrum of Fig. 7.10b for DSBSC modulation with that of Fig. 
7.2b for standard amplitude modulation, we clearly see that the carrier is 
suppressed in the former case, whereas it is present in the latter case, as 
exemplified by the existence of the pair of delta functions at +f,. 


GENERATION OF DSBSC WAVES 


A double-sideband suppressed-carrier modulated wave consists simply of 
the product of the message signal and the carrier wave, as shown by Eq. 
7.28. A device for achieving this requirement is called a product modulator. 
In this section, we describe two forms of a product modulator—the bal- 
anced modulator and the ring modulator. 


Balanced Modulator A balanced modulator consists of two standard am- 
plitude modulators arranged in a balanced configuration so as to suppress 
the carrier wave, as shown in the block diagram of Fig. 7.11. We assume 
that the two modulators are identical, except for the sign reversal of the 
modulating wave applied to the input of one of them. Thus, the outputs 
of the two modulators may be expressed as follows: 


s,(t) = A,[1 + k,m(t)] cos(2zf,t) 
and 

s(t) = A[1 — k,m(t)] cos(27 f.t) 
Subtracting s,(t) from s,(t), we obtain 


s(t) = s,(t) — s(t) 
2k,A, cos(2r f.t) m(t) (7.30) 


Hence, except for the scaling factor 2k,, the balanced modulator output 
is equal to the product of the modulating wave and the carrier, as required.. 


Ring Modulator One of the most useful product modulators that is well- 
suited for generating a DSBSC modulated wave is the ring modulator shown 
in Fig. 7.12a; it is also known as a lattice or double-balanced modulator. 
The four diodes in Fig. 7.12a form a ring in which they all point in the 
same way. The diodes are controlled by a square-wave carrier c(t) of 
frequency f., which is applied by means of two center-tapped transformers. 
We assume that the diodes are ideal and the transformers are perfectly 
balanced. When the carrier supply is positive, the outer diodes are switched 
on, presenting zero impedance, whereas the inner diodes are switched off, 
presenting infinite impedance, as in Fig. 7.12b, so that the modulator 
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mia modulator 


A. cos (27f,t) 


A, cos (2rf,t) 


AM 


maa modulator 


Figure 7.11 
Balanced modulator. 
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Figure 7.12 rf 
Ring modulator. (a) Circuit diagram. (b) The condition when the outer diodes are 


switched on and the inner diodes are switched off. (c) The condition when the outer 
diodes are switched off and the inner diodes are switched on. 
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multiplies the message signal m(t) by +1. When the carrier supply is 
negative, the situation becomes reversed as in Fig. 7.12c, and the modulator 
multiplies the message signal by — 1. Thus the ring modulator, in its ideal 
form, is a product modulator for a square-wave carrier and the message 
signal, as illustrated in Fig. 7.13 for the case of a sinusoidal modulating 
wave. 

The square-wave carrier c(t) can be represented by a Fourier series as 


c(t) = : 5 a -cosl2nf.t(2n =] (7.31) 


The ring modulator output is therefore 


aR 
= 2. enin - cos [2xf.t(2n — 1)|m(t) (7.32) 


s(t) 


We see that there is no output from the modulator at the carrier frequency; 
that is, the modulator output consists entirely of modulation products. 


m(t) 


(a) 


c(t) 


(b) 


s(t) 


——> time 
(c) 
Figure 7.13 
Waveforms illustrating the operation of the ring modulator for a sinusoidal 


modulating wave. (a) Modulating wave. (b) Square-wave carrier. (c) Modulated 
wave. 
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_ EXERCISE 5 The spectrum of the ring modulator output s(t), defined by 
_ Eq. 7.32, consists of sidebands around the fundamental frequency of the 
-~ square wave c(t) and its odd harmonics. Suppose that the message signal | 
- m(t) is band-limited to the interval - W < f < W. Hence, show that the 
_ DSBSC modulated wave 4 cos(2zf,t)m(t)/x may be selected by using a 
band-pass filter with the following specifications: 


Midband frequency = f, 
Bandwidth = 2W — 
toe W 


COHERENT DETECTION OF DSBSC MODULATED WAVES 


The message signal m(t) is recovered from a DSBSC wave s(t) by first 
multiplying s(t) with a locally generated sinusoidal wave and then low-pass 
filtering the product, as in Fig. 7.14. It is assumed that the local oscillator 
output is exactly coherent or synchronized, in both frequency and phase, 
with the carrier wave c(t) used in the product modulator to generate s(t). 
This method of demodulation is known as coherent detection or synchron- 
ous detection. 

It is instructive to derive coherent detection as a special case of the 
more general demodulation process using a local oscillator signal of the 
same frequency but arbitrary phase difference ġ, measured with respect 
to the carrier wave c(t). Thus, denoting the local oscillator signal by 
cos(2zf,t + ġ), assumed to be of unit amplitude for convenience, and 
using Eq. 7.28 for the DSBSC modulated wave s(t), we find that the product 
modulator output in Fig. 7.14 is given by 


v(t) = cos(2zf,t + )s(t) 
= A, cos(2zf,t) cos(2xf,t + ¢)m(t) 


= 3A, cospm(t) + 3A, cos(4zf,t + d)m(t) (7253) 
See —_—_—_—_—_—_—_—_—_—___——” 
Scaled version Unwanted term 
of message 
signal 


The low-pass filter in Fig. 7.14 removes the unwanted term in the product 
modulator output of Eq. 7.33. The overall output v,(t) is therefore given 
by 


v,(t) = 2A, cosh m(t) (7.34) 


The demodulated signal v,(t) is therefore proportional to m(t) when the 
phase error ¢ is a constant. The amplitude of this demodulated signal is 


eocrceesscescsccecseesoe 
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cos(2xf.t +) 


Local 
oscillator 


Figure 7.14 
Coherent detection of DSBSC modulated wave. 


maximum when ¢ = 0, and is minimum (zero) when ¢ = +7/2. The zero 
demodulated signal, which occurs for ġo = +7/2, represents the quadrature 
null effect of the coherent detector. Thus the phase error @ in the local 
oscillator causes the detector output to be attenuated by a factor equal to 
cos@. As long as the phase error @ is constant, the detector output provides 
an undistorted version of the original message signal m(t). In practice, 
however, we usually find that the phase error ¢ varies randomly with time, 
owing to random variations in the communication channel. The result is 
that at the detector output, the multiplying factor cosġ also varies randomly 
with time, which is obviously undesirable. Therefore, circuitry must be 
provided in the receiver to maintain the local oscillator in perfect syn- 
chronism, in both frequency and phase, with the carrier wave used to 
generate the DSBSC modulated wave in the transmitter. The resulting 
increase in receiver complexity is the price that must be paid for suppressing 
the carrier wave to save transmitter power. 


EXERCISE 6 Suppose that the message signal m(t) is band-limited to the 
interval -W < f < W. Hence, show that the low-pass filter in Fig. 7.14 
removes the unwanted term in the product modulator output of Eq. 7.33, 
provided that it satisfies the following specifications: 
Midband frequency = f, 
Bandwidth = 2W 
“fou : 


EXAMPLE 2 SINGLE-TONE MODULATION (CONTINUED) 


Consider again the sinusoidal modulating signal 


m(t) = Am cos(27f nt) 


ecceseccceroccesoescase® 


DOUBLE-SIDEBAND SUPPRESSED-CARRIER MODULATION 281 


The corresponding DSBSC modulated wave is given by 


s(t) = A.A, cos(2n f.t) cos(27f nt) 
3A.A,, cos[2n(f, + fmt] + 4A-Am cos[2x(f. — fm)t] (7.35) 


Figure 7.3d is a sketch of this modulated wave. 
The Fourier transform of s(t) is therefore 


SC(F) = 4A. An[O(f — fe — fm) + OCF + fe + fon) 
+ Òf — fe + fm) + OF + fe fr) (7.36) 


Thus the spectrum of the DSBSC modulated wave, for the case of a si- 
nusoidal modulating wave, consists of delta functions located at f, + fp 
and —f, + f,,, aS in Fig, 7.3d. 

Assuming perfect synchronism between the local oscillator in Fig. 7.14 
and the carrier wave, we find that the product modulator output is 


v(t) = cos(2zf,t){zA.A,, cos[2x(f. — fm)t] 
+ 3A.A,, cos[2x(f. + fin)t]} 


= 4A.A,, cos[2n(2fe — f,,)t] + Ac Am cos(2zf,,0) 
+ 4A4.A,, cos[22(2f. + fim)t] + 4A, Am COS(27T fmt) (7.37) 


where the first two terms are produced by the lower side-frequency, and 
the last two terms are produced by the upper side-frequency. The first and 
third terms, of frequencies 2f. — fm and 2f, + fm, respectively, are re- 
moved by the low-pass filter in Fig. 7.14. The coherent detector output 
thus reproduces the original modulating wave. Note, however, that this 
detector output appears as two equal terms, one derived from the upper 
side-frequency and the other from the lower side-frequency. We conclude, 
therefore, that for the transmission of information, only one side-frequency 
is necessary. We will have more to say about this issue in Section 7.4. 
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COSTAS LOOP 


One method of obtaining a practical synchronous receiving system, suitable 
for use with DSBSC modulated waves, is to use the Costas loop* shown 
in Fig. 7.15. This receiver consists of two coherent detectors supplied with 
the same input signal, namely, the incoming DSBSC modulated wave 
A, cos(2zf,t)m(t), but with individual local oscillator signals that are in 
phase quadrature to each other. The frequency of the local oscillator is 


2The Costas loop is named in honor of its inventor; see Costas (1956). 
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Figure 7.15 
Costas loop. 


adjusted to be the same as the carrier frequency f., which is assumed 
known a priori. The detector in the upper path is referred to as the in- 
phase coherent detector or I-channel, and that in the lower path is referred 
to as the quadrature-phase coherent detector or Q-channel. These two de- 
tectors are coupled to form a negative feedback system designed in such 
a way as to maintain the local oscillator synchronous with the carrier wave. 
To understand the operation of this receiver, suppose that the local oscil- 
lator signal is of the same phase as the carrier wave A.cos(2rzf.t) used to 
generate the incoming DSBSC wave. Under these conditions, we find that 
the /-channel output contains the desired demodulated signal m(t), whereas 
the Q-channel output is zero owing to the quadrature null effect of the Q- 
channel. Suppose next the local oscillator phase drifts from its proper value 
by a small amount ¢ radians. The J-channel output will remain essentially 
unchanged, but there will now be some signal appearing at the Q-channel 
output, which is proportional to sind = d. This Q-channel output will have 
the same polarity as the /-channel output for one direction of local oscillator 
phase drift and opposite polarity for the opposite direction of local oscillator 
phase drift. The Z- and Q-channel outputs are combined in a Phase dis- 
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criminator (which consists of a multiplier followed by a low-pass filter). A 
de control signal proportional to the phase error ¢ is obtained at the 
discriminator output. Hence, the receiver automatically corrects for local 
oscillator phase errors. 

It is apparent that phase control in the Costas loop ceases with modu- 
lation, and that phase-lock has to be re-established with the reappearance 
of modulation. This is not a serious problem when receiving voice trans- 
mission, because the lock-up process normally occurs so rapidly that no 
perceptible distortion is observed. 


EXERCISE 7 Show that the phase discriminator output in the receiver of 


4 Fig. 7.15 is proportional to ad, where a is the average value of m?(t) and 
< @ is the phase error (assumed small). 


eeesonsasseconececes 


7.3 QUADRATURE-CARRIER MULTIPLEXING 


A quadrature-carrier multiplexing ot quadrature-amplitude modulation 
(QAM) scheme enables two DSBSC modulated waves (resulting from the 
application of two independent message signals) to occupy the same trans- 
mission bandwidth, and yet it allows for the separation of the two message 
signals at the receiver output. It is therefore a bandwidth-conservation 
scheme. 

Figure 7.16 is a block diagram of the quadrature-carrier multiplexing 
system. The transmitter of the system, shown in part a of the figure, involves 
the use of two separate product modulators that are supplied with two 
carrier waves of the same frequency but differing in phase by —90°. The 
multiplexed signal s(t) consists of the sum of these two product modulator 
outputs, as shown by 


s(t) = A,m,(t) cos(2zf,t) + A,m,(t) sin(2z7f.t) (7.38) 


where m,(t) and m,(t) denote the two different message signals applied to 
the product modulators. Thus, the multiplexed signal s(t) occupies a trans- 
mission bandwidth of 2W, centered at the carrier frequency f., where W 
is the message bandwidth of m,(t) or m,(t), whichever is largest. 

The receiver of the system is shown in Fig. 7.165. The multiplexed signal 
s(t) is applied simultaneously to two separate coherent detectors that are 
supplied with two local carriers of the same frequency, but differing in 
phase by —90°. The output of the top detector is 3A,m,(t), whereas the 
output of the bottom detector is 3A.m,(t). 

For the quadrature-carrier multiplexing system to operate satisfactorily, 
it is important to maintain the correct phase and frequency relationships 
between the local oscillators used in the transmitter and receiver parts of 
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Quadrature-carrier multiplexing system. (a) Transmitter. (b) Receiver. 


the system. This requirement may be satisfied, for example, by using a 
Costas loop; see Section 7.2. 


7.4 SINGLE-SIDEBAND MODULATION 


Standard amplitude modulation and double-sideband suppressed-carrier 
modulation are wasteful of bandwidth because they both require a 
transmission bandwidth equal to twice the message bandwidth. In either 
case, one half the transmission bandwidth is occupied by the upper side- 
band of the modulated wave, whereas the other half is occupied by the 
lower sideband. However, the upper and lower sidebands are uniquely 
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related to each other by virtue of their symmetry about the carrier fre- 
quency; that is, given the amplitude and phase spectra of either sideband, 
we can uniquely determine the other. This means that insofar as the trans- 
mission of information is concerned, only one sideband is necessary, and 
if both the carrier and the other sideband are suppressed at the transmitter, 
no information is lost. Thus the channel needs to provide only the same 
bandwidth as the message signal, a conclusion that is intuitively satisfying. 
When only one sideband is transmitted, the modulation is referred to as 
single-sideband modulation. 

In the study of standard amplitude modulation and double sideband- 
suppressed carrier modulation, pursued in Sections 7.1 and 7.2, we first 
formulated a time-domain description of the modulated wave and then 
moved on to its frequency-domain description. In the study of single- 
sideband modulation, we find it easier in conceptual terms to reverse the 
order in which these two descriptions are presented. 


FREQUENCY-DOMAIN DESCRIPTION 


The precise frequency-domain description of a single-sideband (SSB) mod- 
ulated wave depends on which sideband is transmitted. Consider a message 
signal m(t) with a spectrum M(f) limited to the band -W < f < W, as 
in Fig. 7.17a. The spectrum of the DSBSC modulated wave, obtained by 
multiplying m(t) by the carrier wave A, cos(27f,t), is as shown in Fig. 
7.17b. The upper sideband is represented in duplicate by the frequencies 
above f, and those below —f,; and when only the upper sideband is 
transmitted, the resulting SSB modulated wave has the spectrum shown 
in Fig. 7.17c. Likewise, the lower sideband is represented in duplicate by 
the frequencies below f. (for positive frequencies) and those above — f, 
(for negative frequencies); and when only the lower sideband is transmit- 
ted, the spectrum of the corresponding SSB modulated wave is as shown 
in Fig. 7.17d. Thus the essential function of SSB modulation is to translate 
the spectrum of the modulating wave, either with or without inversion, to 


Message spectrum 


M(f) 
M(0) 


-W 0 W f 
(a) 
Figure 7.17 
(a) Spectrum of message signal. (b) Spectrum of DSBSC modulated wave. (c) 


Spectrum of SSB modulated wave with the upper sideband transmitted. (d) 
Spectrum of SSB modulated wave with the lower sideband transmitted. 


286 MODULATION TECHNIQUES 


DSBSC spectrum’ 


=e ae 0 fe ake WF 


-f -f+ W 0 f.-W fe f 


Figure 7.17 (continued) 


a new location in the frequency domain. Moreover, the transmission band- 
width requirement of an SSB modulation system is one half that of a 
standard AM or DSBSC modulation system. The benefit of using SSB 
modulation is therefore derived principally from the reduced bandwidth 
requirement and the elimination of the high-power carrier wave. The prin- 
cipal disadvantage of SSB modulation, however, is the cost and complexity 
of its implementation. 


FREQUENCY DISCRIMINATION METHOD FOR GENERATING AN SSB 
MODULATED WAVE 


The frequency-domain description presented for SSB modulation leads us 
naturally to the frequency discrimination method for generating an SSB 
modulated wave. Application of the method, however, requires that the 
message signal satisfy two conditions: 


1. The message signal m(t) has little or no low-frequency content; that is, 
the message spectrum M(f) has “holes” at zero frequency. An impor- 
tant type of message signal with such a property is an audio signal 


m(t) 
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(speech or music). In telephony, for example, the useful frequency 
content of a speech signal is restricted to the band 0.3-3.4 kHz, thereby 
creating an energy gap from zero to 300 Hz. 


2. The highest frequency component W of the message signal m(t) is much 
less than the carrier frequency f,. 


Then, under these conditions, the desired sideband will appear in a non- 
overlapping interval in the spectrum in such a way that it may be selected 
by an appropriate filter. Thus an SSB modulator based on frequency dis- 
crimination consists basically of a product modulator and a filter designed 
to pass the desired sideband of the DSBSC modulated wave at the product 
modulator output and reject the other sideband. A block diagram of this 
modulator is shown in Fig. 7.18a. The most severe requirement of this 
method of SSB generation usually arises from the unwanted sideband, the 
nearest frequency component of which is separated from the desired side- 
band by twice the lowest frequency component of the message signal. 

In designing the band-pass filter in the SSB modulation scheme of Fig. 
7.18a, we must therefore satisfy two basic requirements: 


1. The passband of the filter occupies the same frequency range as the 
spectrum of the desired SSB modulated wave. 


2. The width of the guardband of the filter, separating the passband from 
the stopband where the unwanted sideband of the filter input lies, is 
twice the lowest frequency component of the message signal. 

We usually find that this kind of frequency discrimination can be satisfied 


only by using highly selective filters, which can be realized using crystal 
resonators with a Q factor per resonator in the range of 1000 to 2000. 


Product Band-pass 
modulator filter 
A, cos (2mf,t) (a) 
Product Band-pass Product 
modulator filter modulator 


A, cos (2nf,t) A, cos (2rf2t) 
(b) 


SSB 
modulated wave 


SSB 


Band-pass 
filter 


Figure 7.18 
(a) Block diagram of the frequency discrimination method (single stage) for 
generating SSB modulated waves. (b) Block diagram of a two-stage SSB modulator. 


modulated wave 
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When it is necessary to generate an SSB modulated wave occupying a 
frequency band that is much higher than that of the message signal (e.g., 
translating a voice signal to the high-frequency region of the radio spec- 
trum), it becomes very difficult to design an appropriate filter that will pass 
the desired sideband and reject the other using the simple arrangement of 
Fig. 7.18a. In such a situation it is necessary to resort to a multiple-mod- 
ulation process so as to ease the filtering requirement. This approach is 
illustrated in Fig. 7.18b involving two stages of modulation. The SSB mod- 
ulated wave at the first filter output is used as the modulating wave for the 
second product modulator, which produces a DSBSC modulated wave with 
a spectrum that is symmetrically spaced about the second carrier frequency 
f2- The frequency separation between the sidebands of this DSBSC mod- 
ulated wave is effectively twice the first carrier frequency f,, thereby per- 
mitting the second filter to remove the unwanted sideband. 


TIME-DOMAIN DESCRIPTION 


The spectra shown in Fig. 7.17 clearly display the frequency-domain de- 
scription of SSB modulated waves; also, they highlight the relation between 
this frequency-domain description and that of the message signal. It is 
interesting to observe that we were able to relate the spectral content of 
SSB modulated waves to that of the message signal without having to resort 
to the use of mathematics. But how do we define an SSB modulated wave 
in the time domain? The answer to this question is desired not only because 
it completes the description of SSB modulated waves but also it provides 
the mathematical basis of another method for their generation. Unfortu- 
nately, the task of developing the time-domain description of SSB mod- 
ulated waves is mathematically more difficult than that of standard AM or 
DSBSC modulated waves. To solve the problem, we use the idea of a 
complex envelope, which was discussed in Section 3.5. 

Consider first the mathematical representation of an SSB modulated 
wave 5,(t), in which only the upper sideband is retained. The spectrum of 
this modulated wave is depicted in Fig. 7.17c. We recognize that s,(t) may 
be generated by passing a DSBSC modulated wave through a band-pass 
filter of transfer function H,(f). The DSBSC spectrum is illustrated in Fig. 
7.17b, which corresponds to the message spectrum M(f) of Fig. 7.17a. As 
for the transfer function H,(f), ideally, it has the frequency dependence 
shown in Fig. 7.19a. 

The DSBSC modulated wave is defined by 


Spssc(t) = A.m(t) cos(27f.t) (7.39) 


where m(t) is the message signal and A, cos(2zf,t) is the carrier wave. 
Naturally, it is a band-pass signal with an in-phase component only. The 
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Figure 7.19 

(a) Frequency response of ideal band-pass filter for selecting the upper sideband of 
a DSBC modulated wave. (b) Frequency response of equivalent low-pass filter. (c) 
Spectrum of complex envelope of DSBSC modulated wave. 


low-pass complex envelope of the DSBSC modulated wave is given by 
Spspsc(t) = Aem(t) (7.40) 


The SSB modulated wave s,(t) is also a band-pass signal. However, unlike 
the DSBSC modulated wave, it has a quadrature as well as an in-phase 
component. Let the low-pass signal 5,(t) denote the complex envelope of 
5,(t). We may then write 


s,(t) = Re[s,(t) exp(j27f.t)] (7.41) 


To determine §,(t), we proceed as follows (see Section 3.5): 


1. The band-pass filter of transfer function H,(f) is replaced by an equiv- 
alent low-pass filter of transfer function H,(f), which is as shown in Fig. 
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7.19b. From this figure, we see that H,(f) may be expressed as 


ny = {QT Y am 


where sgn(f) is the signum function. 


2. The DSBSC modulated wave is replaced by its complex envelope. The 
spectrum of this envelope is as shown in Fig. 7.19c, which follows from 
Eq. 7.40. That is to say, 


Sosase(f) = AM(f) (7.43) 


3. The desired complex envelope §,(t) is determined by evaluating the 
inverse Fourier transform of the product H,(f)Spspsc(f). Since, by defi- 
nition, the message spectrum M(f) is zero outside the frequency interval 
-W < f < W, we find from Eqs. 7.42 and 7.43 that 


ALE Soss) = FEU + sea PIMC) (1.44) 


Given that m(t) = M(f), we find (from Example 3 of Chapter 3) that 
the corresponding Fourier transform pair for #(t), the Hilbert transform 
of m(t), is 


Alt) —= -j sen(f)M(f) (7.45) 


Accordingly, the inverse Fourier transformation of Eq. 7.44 yields 
> A, Se 
sult) = > Im) + ja] (7.46) 


which is the desired result. 

Having determined §,(t), we are now ready to formulate the mathe- 
matical description of the SSB modulated wave s,(t). Specifically, placing 
Eq. 7.46 in Eq. 7.41, we get 


s(t) = a [m(t) cos(2zf,t) — M(t) sin(2zf,t)] (7.47) 


This equation reveals that, except for a scaling factor, a modulated wave 
containing only an upper sideband has an in-phase component equal to 
the message signal m(t) and a quadrature component equal to m(t), the 
Hilbert transform of m(t). 
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EXERCISE 8 Let t sft) dente an SSB eatin wave in which only the 
lower sideband i is retained. To determine si(t), proceed as follows: 


1. Identify the transfer function H,( f) of a band-pass filter the output of 
-~ which equals s,(¢) in response to a DSBSC modulated wave. 


_ 2. Determine the transfer function H,(f) of the ganivaltent low-pass filter 


corresponding to H,(f). . 
3.; Hence, using the wae in parts (1) and (2), show that s,(t) is given by 
s(t) = = 2 Ime) cos(2n f.t) + M(t) sin(27f.t)] (7.48) 


_ What are the ee and quadrature components of s(t)? 


DISCUSSION 


Equations 7.47 and 7.48 are canonical representations of upper and lower 
sidebands modulated on a carrier of frequency f.. These two equations 
clearly demonstrate how the upper and lower sidebands can be isolated 
from each other by subtracting or adding the outputs of two product mod- 
ulators. The modulators differ from each other by the insertion of — 90° 
phase shifts between the modulating waves as well as between the carrier 
waves at their inputs; we will have more to say on this issue when we 
revisit the generation of SSB modulated waves. The mathematical com- 
plexity of Eqs. 7.47 and 7.48, involving not only the message signal m(t) 
but also its Hilbert transform m(t), makes it difficult for us to sketch the 
waveforms of SSB modulated waves, in general. We therefore have to 
resort to the use of single-tone modulation in order to infer time-domain 
properties of SSB modulation. 


EXAMPLE 3 SINGLE-TONE MODULATION (CONTINUED) 


Consider again the sinusoidal modulating wave 
m(t) = Am cos(27f,,t) (7.49) 


The Hilbert transform of this signal is obtained by passing it through a 
— 90° phase shifter, which yields 


m(t) = Am sin(27f pt) (7.50) 


Therefore, substituting Eqs. 7.49 and 7.50 in 7.47, we find that the SSB 
wave, obtained by transmitting only the upper side-frequency, is defined 
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by 


s(t) = 3A,A,,[cos(27f nt) cos(2n f.t) — sin(27f,,t) sin(27f,t)] 
= 3A.A,, cos[2n(fc + fm)t] 
(7.51) 


This is exactly the same as the result obtained by suppressing the lower 
side-frequency f. — fm of the corresponding DSBSC wave of Eq. 7.35. 
The SSB wave of Eq. 7.51 and its spectrum are illustrated in Fig. 7.3e. 

Next, using Eq. 7.48, we find that the SSB wave, obtained by trans- 
mitting only the lower side-frequency, is defined by 


s(t) = 3A.A,,[cos(2zf,,t) cos(2xf.t) + sin(2zf,t) sin(27 fmt)] 
: = $A.A,, cos[2n(f. — fm)t] (7.52) 


which is exactly the same as the result obtained by suppressing the upper 
side-frequency f. + fm of the DSBSC wave of Eq. 7.35. The SSB wave 
of Eq. 7.52 and its spectrum are illustrated in Fig. 7.3f. 


POCCR SCO COD TOSS TOHOSED DED AOOTEELEOOSTOS SESE SES OS ODDS OESEOO OSES SSOSSSOOSOGS OS SSO SSESESSHESHSOSSSSS OSSD OSOSSSSSSOSSSOSSOSESOD 


PHASE DISCRIMINATION METHOD FOR 
GENERATING AN SSB MODULATED WAVE 


The phase discrimination method of generating an SSB modulated wave 
involves two separate simultaneous modulation processes and subsequent 
combination of the resulting modulation products, as shown in Fig. 7.20. 
The derivation of this system follows directly from Eq. 7.47 or 7.48, which 
defines the canonical representation of SSB modulated waves in the time- 
domain. The system uses two product modulators, J and Q, supplied with 
carrier waves in phase quadrature to each other. The incoming baseband 
signal m(t) is applied to product modulator 7, producing a modulated 
DSBSC wave that contains reference phase sidebands symmetrically spaced 
about carrier frequency f.. The Hilbert transform 7(t) of m(t) is applied 
to product modulator Q, producing a DSBSC modulated wave that contains 
sidebands having identical amplitude spectra to those of modulator J, but 
with phase spectra such that vector addition or subtraction of the two 
modulator outputs results in cancellation of one set of sidebands and re- 
inforcement of the other set. The use of a plus sign at the summing junction 
yields an SSB wave with only the lower sideband, whereas the use of a 
minus sign yields an SSB wave with only the upper sideband. In this way 
the desired SSB modulated wave is produced. The SSB modulator of Fig. 
7.20 is also known as the Hartley modulator. 
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Figure 7.20 
Block diagram of the phase discrimination method for generating SSB modulated 


waves. 


DEMODULATION OF SSB WAVES 


To recover the baseband signal m(t) from the SSB wave s(t), equal to 
s,(t) or s,(t), we have to shift the spectrum in Fig. 7.17c or d by the amounts 
+ f. so as to convert the transmitted sideband back into the baseband signal. 
This can be accomplished using coherent detection, which involves applying 
the SSB wave s(t), together with a locally generated carrier cos(27f,t), 
assumed to be of unit amplitude for convenience, to a product modulator 
and then low-pass filtering the modulator output, as in Fig. 7.21. Thus, 
using Eq. 7.47 or 7.48, we find that the product modulator output is given 


by 


v(t) = cos(2zf,t)s(t) 

4A, cos(2zf,t)[m(t) cos(2zf.t) + A(t) sin(2z7f.t)] 

= 4A.m(t) + 4A,[m(t) cos(4n f.t) + M(t) sin(4zf,t)] 
o m E ee a 


Scaled Unwanted component 
message 


signal (7.53) 
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s(t) modulator filter volt) 
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Figure 7.21 
Coherent detection of an SSB modulated wave. 


The first term in Eq. 7.53 is the desired message signal. The combination 
of the remaining terms represents an SSB modulated wave with a carrier 
frequency of 2f,; as such, it represents an unwanted component in the 
product modulator output that is removed by low-pass filtering. 

The detection of SSB modulated waves, just presented, assumes ideal 
conditions, namely, perfect synchronization between the local carrier and 
that in the transmitter both in frequency and phase. The effect of a phase 
error ¢ in the locally generated carrier wave is to modify the detector 
output as follows’ 


v(t) = 4A.m(t) cosh + 4A,m(t) sing (7.54) 


where the plus sign applies to an incoming SSB modulated wave containing 
only the upper sideband (i.e., the modulated wave of Eq. 7.47), and the 
minus sign applies to one containing only the lower sideband (i.e., the 
modulated wave of Eq. 7.48). Owing to the phase error ¢, the detector 
output v,(t) contains not only the message signal m(t) but also its Hilbert 
transform /(t). Consequently, the detector output suffers from phase dis- 
tortion. This phase distortion is usually not serious with voice communi- 
cations because the human ear is relatively insensitive to phase distortion. 
The presence of phase distortion gives rise to what is called the Donald 
Duck voice effect. In the transmission of music and video signals, on the 
other hand, phase distortion in the form of a constant phase difference in 
all components can be intolerable. 


EXERCISE 9 a that aie tie filter i in “hg ound detects of 
Fig. 7.21 only passes the message signal oe of th >: ien mod- SS 
ulator output, provided. it satisfies the fol i s 


(a) Bandwidth = W , 7 
(b) Width of guardband < 2. - aW, Saak a = 1 for an SSB mod- 


*For a more complete discussion of the effects of carrier phase and frequency errors 
in single-sideband modulation, see Haykin (1983, pp. 146-149). 
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ulated wave containing only the upper sideband, and a = 2 for an SSB 
modulated wave containing only the lower sideband. 


EXERCISE 10 Let cos(2zf.t + $) denote the local carrier applied to the 
product modulator in Fig. 7.21. Show that the effect of the phase error ¢ 
is to modify the detector output v,(t) as in Eq. 7.54. 


7.5 VESTIGIAL SIDEBAND MODULATION 


Single-sideband modulation is well-suited for the transmission of voice 
because of the energy gap that exists in the spectrum of voice signals 
between zero and a few hundred hertz. When the message signal contains 
significant components at extremely low frequencies (as in the case of 
television signals and wideband data), the upper and lower sidebands meet 
at the carrier frequency. This means that the use of SSB modulation is 
inappropriate for the transmission of such message signals owing to the 
difficulty of isolating one sideband. This difficulty suggests another scheme 
known as vestigial sideband modulation (VSB), which is a compromise 
between SSB and DSBSC modulation. In this modulation scheme, one 
sideband is passed almost completely whereas just a trace, or vestige, of 
the other sideband is retained. 


FREQUENCY-DOMAIN DESCRIPTION 


Figure 7.22 illustrates the spectrum of a vestigial sideband (VSB) modulated 
wave s(t) in relation to that of the message signal m(t), assuming that the 
lower sideband is modified into the vestigial sideband. Specifically, the 
transmitted vestige of the lower sideband compensates for the amount 
removed from the upper sideband. The transmission bandwidth required 
by the VSB modulated wave is therefore given by 


B=W+ f, (7.55) 


where W is the message bandwidth and f, is the width of the vestigial 
sideband. 

Vestigial sideband modulation has the virtue of conserving bandwidth 
almost as efficiently as single-sideband modulation, while retaining the 
excellent low-frequency baseband characteristics of double-sideband mod- 
ulation. Thus VSB modulation has become standard for the transmission 
of television and similar signals where good phase characteristics and trans- 
mission of low-frequency components are important, but the bandwidth 
required for double-sideband transmission is unavailable or uneconomical. 
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Figure 7.22 
(a) Spectrum of message signal. (b) Spectrum of VSB modulated wave containing a 
vestige of the lower sideband. 


GENERATION OF VSB MODULATED WAVE 


To generate a VSB modulated wave, we pass a DSBSC modulated wave 
through a sideband shaping filter, as in Fig. 7.23a. The exact design of this 
filter depends on the desired spectrum of the VSB modulated wave. The 
relation between the transfer function H(f) of the filter and the spectrum 
S(f) of the VSB modulated wave s(t) is defined by 


S(f) = SIME - f) + M+ PH 05) 


where M(f) is the message spectrum. We wish to determine the specifi- 
cation of the filter transfer function H (f), so that S(f) defines the spectrum 
of the desired VSB wave s(t). This can be established by passing s(t) 
through a coherent detector and then determining the necessary condition 
for the detector output to provide an undistorted version of the original 
message signal m(t). Thus, multiplying s(¢) by a locally generated sine- 
wave cos(2zf,t), which is synchronous with the carrier wave A, cos(27f,t) 
in both frequency and phase, as in Fig. 7.23b, we get 


v(t) = cos(27f,t)s(t) (7.57) 


Transforming this relation into the frequency domain gives the Fourier 


VESTIGIAL SIDEBAND MODULATION 297 


Sideband 
shaping 
filter 


m(t) Product 


modulator 


VSB wave 
s(t) 


A, cos(27f,t) 
(a) 


VSB wave 
s(t) 


Product volt) 


modulator 


Low-pass 
filter 


A, cos(2rf,t) 
(b) 

V (f) 

ft 

i 
=e -W 0 W 2f 
+W ft W 
fy (c) 
V (f) 
- M(0) [H fe) + A(f,J) 
-W 0 W 

(d) 


i 7.23 
ene for the generation and demodulation of a VSB modulated wave. (a) Block 
diagram of VSB modulator. (b) Block diagram of VSB demodulator. (c) Spectrum of 
the product modulator output v(t) in the demodulation scheme. (d) Spectrum of the 
demodulated signal v,(t). 
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transform of v(t) as 
V) = FISE - F) + SF + So (7.58) 


Therefore, substitution of Eq. 7.56 in 7.58 yields 


V) = SEMI -= f) + HU + fo 


+ IMG - SDHC - f) + MUL + SAG + f 
(7.59) 


The spectrum V(f) is illustrated in Fig. 7.23c. The second term in Eq. 
7.59 represents a VSB wave corresponding to carrier frequency 2f.. This 
term is removed by the low-pass filter in Fig. 7.23b to produce an output 
vo(t), the spectrum of which is given by 


VS) = FEMS - f+ HEIN (7.60) 


The spectrum V,(f) is illustrated in Fig. 7.23d. For a distortionless repro- 
duction of the original baseband signal m(t) at the coherent detector out- 
put, we require V,(f) to be a scaled version of M(f). This means, there- 
fore, that the transfer function H(f) must satisfy the condition 


Wf = Je) AG i ee) (7.61) 


where H(f.) is a constant. With the message spectrum M(f) assumed to 
be essentially zero outside the interval -W < f < W, we need to satisfy 
Eq. 7.61 only for values of f in this interval. 

The requirement of Eq. 7.61 is satisfied by using a filter with a frequency 
response H(f) such as that shown in Fig. 7.24 for positive frequencies. 
This response is normalized so that H(f) falls to one half at the carrier 
frequency f.. The cutoff portion of this response around f, exhibits odd 
symmetry in the sense that inside the transition interval defined by 
fe — fe Sf = fe + fo, the sum of the values of H(f) at any two frequencies 
equally displaced above and below f, is unity. Such a filter is much less 
elaborate than that required if one sideband is to be completely suppressed. 

In general, to preserve the baseband spectrum, the phase response of 
the sideband shaping filter in Fig. 7.23a must exhibit odd symmetry about 
the carrier frequency f.. Specifically, it must be linear over the frequency 
intervals f, — f, < |f| < fe +W, and its value at the frequency f, has to 
equal zero or an integer multiple of 27 radians. The effect of this linear 
phase characteristic is merely to introduce a constant delay in the recovery 
of the message signal m(t) at the receiver output. 
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fe fe+fo fe+W 


Jemi 


Figure 7.24 

Frequency response of sideband shaping filter for a VSB modulated wave 
containing a vestige of lower sideband; only the positive-frequency portion is 
shown. 


The frequency response of Fig. 7.24 pertains to a VSB modulated wave 
containing a vestige of the lower sideband. In the situation depicted here, 
control over the frequency response of the sideband shaping filter need 
only be exercised over the band f. — f, < |f| = fe + W. This is the reason 
for showing the frequency response of the sideband shaping filter in Fig. 
7.24 for f > fe + W as a dashed line. 


EXERCISE 11 Construct the positive-frequency portion of the frequency 
response of a sideband shaping filter for a VSB modulated wave that 
-= contains a vestige of the upper sideband. 


TIME-DOMAIN DESCRIPTION 


Our next task is to determine the time-domain description of a VSB mod- 
ulated wave. To do this, we follow a procedure similar to that used for 
SSB modulated waves in Section 7.4. 

Let s(t) denote a VSB modulated wave containing a vestige of the lower 
sideband. This modulated wave may be viewed as the output of a sideband 
shaping filter produced in response to a DSBSC modulated wave defined 
in Eq. 7.39. The filter has a transfer function H(f) as illustrated in Fig. 
7.24. Using the band-pass to low-pass transformation technique of Section 
3.5, we may replace the sideband shaping filter by an equivalent complex 
low-pass filter of transfer function H(f), which is depicted in Fig. 7.25a. 
(For convenience of presentation, we have ignored the dashed portion of 
H(f) in Fig. 7.24 as it is not pertinent to our present discussion.) Clearly, 
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(d) 


Figure 7.25 

(a) Idealized frequency response H(f) of a low-pass filter equivalent to the sideband 
shaping filter that passes a vestige of the lower sideband. (b) First component of 
H(f). (c) Second component of H(f). (d) Frequency response of a filter with transfer 
function jHa(f). 


we may express H(f) as the difference between two components H,(f) 
and H,(f) as shown by 


A(f) = Áf) — Af) (7.62) 
These two components are described individually as follows: 
1. The transfer function H,,(f), shown in Fig. 7.25b, pertains to a complex 


low-pass filter equivalent to a band-pass filter designed to reject the 
lower sideband completely; it is defined in Eq. 7.42. 
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2. The transfer function H,(f), shown in Fig. 7.25c, accounts for both the 
generation of a vestige of the lower sideband and the removal of a 
corresponding portion from the upper sideband. 


Thus, substituting Eq. 7.42 in 7.62, we may redefine the transfer function 
H(f) as 


1 z 
> = — —fi,<f< 
0, otherwise 
The signum function sgn(f) and the transfer function H,(f) are both 
odd functions of the frequency f. Hence, they both have purely imaginary 


inverse Fourier transforms. Accordingly, we may introduce a new transfer 
function 


He 5 [sen(f) TR (7.64) 


that has a purely real inverse Fourier transform. Let hg(t) denote the 
inverse Fourier transform of Hg(f); that is, 


ho(t) = Ho(f) (7.65) 


Figure 7.25d shows a plot of jHọ(f) as a function of frequency in accord- 
ance with both Eq. 7.64 and Fig. 7.25c. To go on with our task, we rewrite 
Eq. 7.63 in terms of Ho(f) as 


ÄP = Ti Page — loaf W (7.66) 


0, elsewhere 


We are now ready to determine the VSB modulated wave s(t). First, 
we write 


s(t) = Re[S(t) exp(j2zf,t)] (7.67) 
where S(t) is the complex envelope of s(t). Since 5(t) is the output of the 
complex low-pass filter of transfer function H(f), which is produced in 


response to the complex envelope of the DSBSC modulated wave, we may 
express the spectrum of §(t) as 


S(f) = H(f)Spsssc(f) (7.68) 


where Spspsc(f) is defined in Eq. 7.43. Hence, substituting Eqs. 7.43 and 
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7.66 in 7.68, we get 


[1 + jAo(f)IM(f) (7.69) 


Sip) = = 


Taking the inverse Fourier transform of S(f), we thus obtain 


s(t) = fE mÀ + jmo] (7.70) 


where mo(t) is the response produced by passing the message signal m(t) 
through a low-pass filter of impulse response hg(t). Finally, substituting 
Eq. 7.70 in 7.67, we get 


s(t) = fs m(t) cos(27z f.t) — = = moli) sin(2z f.t) (7.71) 


This is the desired representation for a VSB modulated wave containing 
a vestige of the lower sideband.* The component $A,m(t) constitutes the 
in-phase component of this VSB modulated wave, and 2A,mo(t) consti- 
tutes the quadrature component. 

The DSBSC and SSB waves may be regarded as special cases of the 
VSB modulated wave defined by Eq. 7.71. If the vestigial sideband is 
increased to the width of a full sideband, the resulting wave becomes a 
DSBSC wave with the result that mọo(t) vanishes. If, on the other hand, 
the width of the vestigial sideband is reduced to zero, the resulting wave 
becomes an SSB wave containing the upper sideband, with the result that 
mo(t) = M(t), where m(t) is the Hilbert transform of m(t). 


EXERCISE 12 Show that a VSB modulated wave O, containing a vestige 
of the upper sideband, is defined by 


s(t) = = Ami) cos(2nf.t) + = 5A Molt) sin(2xf.t) (7.72) 


where m(t) is the message signal, and mọ(t) is defined by Eqs. 7. 64 and 
7.65. 


“Another time-domain representation of a VSB modulated signal consists of the 
product of a narrow-band “envelope” function and an SSB modulated signal. For 
details of this representation, see Hill (1974). 
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EXERCISE 13 How would you modify the block diagram of Fig. 7.20 so 
that it may be used to generate VSB modulated waves? 


ENVELOPE DETECTION OF A VSB WAVE PLUS CARRIER 


In commercial television broadcasting, a sizable carrier is transmitted to- 
gether with the modulated wave. This makes it possible to demodulate the 
incoming modulated wave by an envelope detector in the receiver. It is, 
therefore, of interest to determine the distortion introduced by the enve- 
lope detector. Adding the carrier component A, cos(27f,t) to Eq. 7.71, 
scaled by a factor k,, modifies the modulated wave applied to the envelope 
detector input as 


s(t) = A.[1 + 2k,m(t)] cos(27 f.t) — tk,A.mo(t) sin(27f,t) 
(7-73) 


where the constant k, determines the percentage modulation. The envelope 
detector output, denoted by a(t), is therefore 


a(t) = AJ{1 + $k,m(t)P + [$k,mo(t)P}? 


magi t emo fi [EO T)" amw 


Equation 7.74 indicates that the distortion is contributed by the quadrature 
component mo (rt) of the incoming VSB wave. This distortion can be re- 
duced using two methods: (1) reducing the percentage modulation to re- 
duce k, and (2) increasing the width of the vestigial sideband to reduce 
m(t). Both methods are used in practice. In commercial television broad- 
casting, the vestigial sideband occupies a width of about 1.25 MHz, or 
about one-quarter of a full sideband. This has been determined empirically 
as the width of vestigial sideband required to keep the distortion due to 
mo(t) within tolerable limits when the percentage modulation is nearly 
100. 


pescreresesenesseonee 7.6 COMPARISON OF AMPLITUDE 
MODULATION TECHNIQUES 


Having studied the characteristics of the different forms of amplitude mod- 
ulation, we are now in a position to compare their practical merits: 


1. In standard AM systems the sidebands are transmitted in full, accom- 
panied by the carrier. Accordingly, demodulation is accomplished sim- 
ply by using an envelope detector or square-law detector. On the other 
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hand, in suppressed-carrier systems the receiver is more complex be- 
cause additional circuitry must be provided for the purpose of carrier 
recovery. It is for this reason we find that in commercial AM radio 
broadcast systems, which involve one transmitter and numerous receiv- 
ers, standard AM is used in preference to DSBSC or SSB modulation. 

2. Suppressed-carrier modulation systems have an advantage over stan- 
dard AM systems in that they require much less power to transmit the 
same amount of information, which makes the transmitters for such 
systems less expensive than those required for standard AM. Sup- 
pressed-carrier systems are therefore well-suited for point-to-point com- 
munication involving one transmitter and one teceiver, which would 
justify the use of increased receiver complexity. 

3. Single-sideband modulation requires the minimum transmitter power 
and minimum transmission bandwidth possible for conveying a message 
signal from one point to another. We thus find that single-sideband 
modulation is the preferred method of modulation for long-distance 
transmission of voice signals over metallic circuits, because it permits 
longer spacing between the repeaters, which is a more important con- 
sideration here than simple terminal equipment. A repeater is simply 
a wideband amplifier that is used at intermediate points along the trans- 
mission path so as to make up for the attenuation incurred during the 
course of transmission. 

4. Vestigial-sideband modulation requires a transmission bandwidth that 
is intermediate between that required for SSB or DSBSC modulation, 
and the saving can be significant if modulating waves with large band- 
widths are being handled, as in the case of television signals and wide- 
band data. 

5. Double-sideband suppressed-carrier modulation, single-sideband mod- 
ulation, and vestigial-sideband modulation are all examples of linear 
modulation. The output of a linear modulator can be expressed in the 
canonical form 


s(t) = s,(t) cos(Qzf,t) — sg(t) sin(2zf,t) (7.75) 


The in-phase component s,(t) is a scaled version of the incoming mes- 
sage signal m(t). The quadrature component s(t) is derived from m(t) 
by some linear filtering operation. Accordingly, the principle of super- 
position can be used to calculate the modulator output s(t) as the sum 
of responses of the modulator to individual components of m(t). In 
Table 7.1 we have summarized the definitions for s;(t) and sg(t) in 
terms of m(t) for DSBSC, SSB, and VSB modulated waves, assuming 
a carrier of unit amplitude. In a strict sense, ordinary amplitude mod- 
ulation fails to meet the definition of a linear modulator with respect 
to the message signal. If s,(¢) is the AM wave produced by a message 
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Table 7.1 Different Forms of Linear Modulation 
In-phase Quadrature 

Type of component component 

Modulation s,(t) So(t) Comments 

DSBSC m(t) 0 m(t) = message signal 

SSB 

1. Upper 2m(t) am(t) m(t) = Hilbert 
sideband transform of 
transmitted m(t) 

2. Lower 3m(t) —3m(t) 
sideband 
transmitted 

VSB 

1. Vestige of m(t) żmo(t) mo(t) = output of filter 
lower of transfer 
sideband function H)(f), 
transmitted produced by 

m(t) 

2. Vestige of 3m(t) —3mo(t) For the definition of 
upper H,(f), see Eq. 7.69 
sideband 
transmitted 


signal m,(t) and s(t) is the AM wave produced by a second message 
signal m,(t), then the AM wave produced by m,(t) plus m(t) is not 
equal to s,(t) plus s,(t). However, the departure from linearity in AM 
is of a mild sort, such that many of the mathematical procedures ap- 
plicable to linear modulation may be retained. For example, the band- 
pass representation is still applicable to an AM wave, with the in-phase 
and quadrature components defined by, respectively, 


s(t) = 1 + k,m(t) 
and 
So(t) = 0 
where k, is the amplitude sensitivity of the modulator. 


. In both SSB and VSB modulation schemes, the role of the quadrature 


component is merely to interfere with the in-phase component, so as 
to eliminate power in one of the sidebands. Herein lies the reason for 
the fact that SSB- and VSB-modulated waves have favorable spectral 
properties. Note, however, that regardless of the nature of the quad- 
rature component, the message signal m(t) may be recovered from the 
modulated signal s(t) with the use of coherent detection. 


7. The band-pass representation may also be used to describe quadrature 


amplitude modulation. In this case, we have (assuming a carrier of unit 


eenesoocceosseesses 
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amplitude) 

s(t) = m(t) 
and 

Solt) = —m,(t) 


where m,(t) and m,(t) are the two independent message signals at the 
quadrature-modulator input (see Eq. 7.38). _ 
8. The complex envelope of the linearly modulated wave s(t) equals 
s(t) = s(t) + jso(t) 
This compact notation retains complete information about the modu- 
lation process. 


7.7 FREQUENCY TRANSLATION 


In the processing of signals in communication systems, it is often convenient 
or necessary to translate the modulated wave upward or downward in 
frequency, so that it occupies a new frequency band. This frequency trans- 
lation is accomplished by multiplication of the signal by a locally generated 
sine wave, and subsequent filtering. For example, consider the DSBSC 
wave 


s(t) = m(t) cos(27 f.t) (7.76) 


The modulating wave m(t) is limited to the frequency band - W = f < W. 
The spectrum of s(t) therefore occupies the bands f. - W < f < fe + W 
and — f, — W < f < — f. + W, asin Fig. 7.26a. Suppose that it is required 
to translate this modulated wave downward in frequency, so that its carrier 
frequency is changed from f, to a new value f,, where f, < fe. To accom- 
plish this requirement, we first multiply the incoming modulated wave s(t) 
by a sinusoidal wave of frequency f, supplied by a local oscillator to obtain 


v(t) = s(t) cos(2zf,t) 
= m(t) cos(2zf,t) cos(27f it) 
= m(t) cos[2x(f. — fi)t] + m(t) cos[2x(f. + fit] 
(7 


The multiplier output v,(¢) consists of two DSBSC waves, one with a carrier 
frequency of fe — f, and the other with a carrier frequency of fe + fı. The 
spectrum of v,(t) is therefore as shown in Fig. 7.26b. Let the frequency f, 
of the local oscillator be chosen so that 


fe fiz (7.78) 
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Figure 7.26 

The frequency translation process. (a) Spectrum of DSBSC wave. (b) Spectrum of 
signal obtained by multiplying DSBSC wave with a local carrier. (c) Spectrum of 
desired DSBSC wave, translated downward in frequency. 


Then from Fig. 7.26b we see that the modulated wave with the desired 
carrier frequency f, may be extracted by passing the multiplier output v, (£) 
through a band-pass filter of midband frequency f, and bandwidth 2W, 
provided 


fee fi We fo fa 
or 
tia We (7.79) 
The filter output is therefore 


v(t) = am(t) cos[2n(f. — fi)t] 
= m(t) cos(27f Qt) (7.80) 


This output is the desired modulated wave, translated downward in fre- 
quency, as shown in Fig. 7.26c. 
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v(t) 


Band-pass 
filter 


cos(2rf;t) 


Figure 7.27 
BLock diagram of mixer. 


A device that carries out the frequency translation of a modulated wave 
is called a mixer. The operation itself is called mixing or heterodyning. For 
the implementation of a mixer, we may use a multiplier and band-pass 
filter, as shown in Fig. 7.27. The multiplier is usually constructed by using 
nonlinear or switching devices, similar to modulators. Note that mixing is 
a linear operation in that it completely preserves the relation of the side- 
bands of the incoming modulated wave to the carrier. 


EXERCISE 14 How would you choose a the et oscillator a ene) hi 


; EXAMPLE 4 

Consider an incoming narrow-band signal of bandwidth 10 kHz, and mid- 
band frequency that may lie in the range 0.535-1.605 MHz. It is required 
to translate this signal to a fixed frequency band centered at 0.455 MHz. 
The problem is to determine the range of tuning that must be provided in 
the local oscillator. (The frequencies used in this example pertain to the 
AM broadcast band of frequencies, on which more will be said in Section 
7.9.) 

Let f. denote the midband frequency of the incoming signal, and f, 
denote the local oscillator frequency. Then we may write 


0.535 < f. < 1.605 
and 
fe — fı = 0.455 
where both f, and f, are expressed in MHz. That is, 


fi = fe — 0.455 


ePerrrrrrrTiiTiTriiitittiiitt tr 


When f. = 0.535 MHz, we get f, = 0.08 MHz; and when f. = 1.605 MHz, 
we get fı = 1.15 MHz. Thus the required range of tuning of the local 
oscillator is 0.08-1.15 MHz. 
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eesesesesesesesesse 7.8 FREQUENCY-DIVISION MULTIPLEXING 


Multiplexing is a technique whereby a number of independent signals can 
be combined into a composite signal suitable for transmission over a com- 
mon channel. This operation requires that the signals be kept apart so that 
they do not interfere with each other, and thus they can be separated at 
the receiving end. This is accomplished by separating the signals either in 
frequency or in time. The technique of separating the signals in frequency 
is referred to as frequency-division multiplexing (FDM), whereas the tech- 
nique of separating the signals in time is called time-division multiplexing 
(TDM). In this section, we discuss FDM systems, whereas TDM systems 
= were discussed in Section 5.10. 

A block diagram of an FDM system is shown in Fig. 7.28. The incoming 
message signals are assumed to be of the low-pass type, but their spectra 
do not necessarily have nonzero values all the way down to zero frequency. 
Following each signal input, we have shown a low-pass filter, which is 
designed to remove high-frequency components that do not contribute 
significantly to signal representation but are capable of disturbing other 
message signals that share the common channel. These low-pass filters may 
be omitted only if the input signals are sufficiently band-limited initially. 
The filtered signals are applied to modulators that shift the frequency ranges 
of the signals so as to occupy mutually exclusive frequency intervals. The 
necessary carrier frequencies, to perform these frequency translations, are 
obtained from a carrier supply. For the modulation, we may use any one 
of the processes described in previous sections of this chapter. However, 
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Figure 7.28 
Block diagram of FDM system. 
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the most widely used method of modulation in frequency-division multi- 
plexing is single-sideband modulation, which requires a bandwidth that is 
approximately equal to that of the original message signal. The band-pass 
filters following the modulators are used to restrict the band of each mod- 
ulated wave to its prescribed range. The resulting band-pass filter outputs 
are next combined in parallel to form the input to the common channel. 
At the receiving terminal, a bank of band-pass filters, with their inputs 
connected in parallel, is used to separate the message signals on a fre- 
quency-occupancy basis. Finally, the original message signals are recovered 
by individual demodulators. 


: EXAMPLE 5 COMPARISON OF SSB/FDM WITH PCM/TDM A 


: Consider an FDM system using SSB modulation to transmit 24 independent : 
: voice inputs. Assume a bandwidth of 4 kHz for each voice input. Thus, in : 
: order to accommodate an FDM system using SSB modulation to transmit : 
? the 24 voice inputs, the communication channel must provide the trans- 

mission bandwidth: 


In Example 1, Chapter 6, we showed that for the T1 system (based on 
: the combined use of PCM and TDM), the minimum channel bandwidth 

required to transmit 24 voice inputs is equal to 772 kHz. This is an order i: 
: of magnitude larger than the bandwidth requirement of the corresponding : 
: SSB/FDM system. However, in spite of the excessive transmission band- : 
: width requirement of a PCM system, we find that in practice it is preferred : 
: over an SSB system. This is because PCM offers system flexibility, increased : 
: ruggedness in the presence of noise, and integration of a wide range of 
services into a common digital format (see Chapter 5). 


B = 24 x 4 = 96 kHz ; 


. 
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pesecesecscserscs 7.9 APPLICATION I: RADIO BROADCASTING 


In radio broadcasting, a central transmitter is used to radiate message 
signals for reception at a large number of remote points. The message 
signals transmitted are usually intended for entertainment purposes. There 
are three general types of radio broadcasting, AM broadcasting, which uses 
standard amplitude modulation; FM broadcasting, which uses frequency 
modulation; and television broadcasting, which uses amplitude modulation 
of one carrier for picture transmission and frequency modulation of a 
second carrier for sound transmission. Standard AM radio and television 
(for picture transmission) are considered in this section. Frequency mod- 
ulation is considered in Section 7.11. 
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AM RADIO 


The usual AM radio receiver is of the superheterodyne type, which is 
represented schematically in Fig. 7.29. Basically, the receiver consists of 
a radio frequency (RF) section, a mixer and local oscillator, an intermediate 
frequency (IF) section, and a demodulator. Typical frequency parameters 
of commercial AM radio are: 


RF carrier range = 0.535-1.605 MHz 
Midband frequency of IF section = 455 kHz 
IF bandwidth = 10 kHz 


The incoming amplitude modulated wave is picked up by the receiving 
antenna and amplified in the RF section, which is tuned to the carrier 
frequency of the incoming wave. The combination of mixer and local os- 
cillator (of adjustable frequency) provides a frequency conversion or het- 
erodyning function, whereby the incoming signal is converted to a pre- 
determined fixed intermediate frequency, usually lower than the signal 
frequency. This frequency conversion is achieved without disturbing the 
relation of the sidebands to the carrier. The result of this conversion is to 
produce an intermediate-frequency carrier defined by 


fir = fre 3 fio 


where fio is the frequency of the local oscillator and frp is the carrier 
frequency of the incoming RF signal. We refer to fir as the intermediate 
frequency (IF), because the signal is neither at the original input frequency 
nor at the final baseband frequency. The mixer-local oscillator combination 
is sometimes referred to as the first detector, in which case the demodulator 
is called the second detector. 

The IF section consists of one or more stages of tuned amplification, 
with a bandwidth corresponding to that required for the particular type of 
signal that the receiver is intended to handle. This section provides most 
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Figure 7.29 Pe 
Basic elements of an AM receiver of the superheterodyne type.. 
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of the amplification and selectivity in the receiver. The output of the IF 
section is applied to an envelope detector, the purpose of which is to recover 
the baseband signal. The final operation in the receiver is the power am- 
plification of the recovered message. The loudspeaker constitutes the load 
of the power amplifier. 

The superheterodyne operation refers to the frequency conversion from 
the variable carrier frequency of the incoming RF signal to the fixed IF 
signal. 

In a superheterodyne receiver the mixer will develop an intermediate 
frequency output when the input signal frequency is greater or less than 
the local oscillator frequency by an amount equal to the intermediate 
frequency. That is, there are two input frequencies, namely, |fio + frl, 
which will result in fj; at the mixer output. This introduces the possibility 
of simultaneous reception of two signals differing in frequency by twice 
the intermediate frequency. Accordingly, it is necessary to employ selective 
stages in the RF section (i.e., between the antenna and the mixer) in order 
to favor the desired signal and discriminate against the undesired or image 
signal. The effectiveness of suppressing unwanted image signals increases 
as the number of selective stages in the radio frequency section increases, 
and as the ratio of intermediate-to-signal frequency increases. 


TELEVISION 


Television (TV) refers to the transmission of pictures in motion by means 
of electrical signals. To accomplish this transmission, each complete picture 
has to be sequentially scanned. The scanning process is carried out in a TV 
camera.’ In a black-and-white TV, the camera contains optics designed to 
focus an image on a photocathode that consists of a large number of pho- 
tosensitive elements. The charge pattern so generated on the photosensitive 
surface is scanned by an electron beam, thereby producing an output current 
that varies temporally in accordance with the way in which the brightness 
of the original picture varies spatially from one point to another. The 
resulting output current is called the video signal. 

The type of scanning used in television is called a raster scan; it is 
somewhat analogous to the manner in which we read a printed paper in 
that the scanning is performed from left to right on a line-by-line basis. In 
particular, a picture is divided into 525 lines that constitute a frame. Each 
frame is decomposed into two interlaced fields, each one of which consists 
of 262.5 lines. For convenience of presentation, we will refer to the two 
fields as I and II. The scanning procedure is illustrated in Fig. 7.30. The 


5For a detailed discussion of TV camera imaging devices, black and white, and color 
TV, see Williams (1987, pp. 231-259). 
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Interlaced raster scan. 


lines of field I are depicted as solid lines, and those of field II are depicted 
as dashed lines. The start and end of each field are also included in the 
figure. Field I is scanned first. The scanning spot of the TV camera moves 
with constant velocity across each line of the field from left to right. When 
the end of a particular line is reached, the scanning spot quickly flies back 
(in a horizontal direction) to the start of the next line down in the field. 
This flyback is called the horizontal retrace. The scanning process described 
here is continued until the whole field has been accounted for. When this 
condition is reached, the scanning spot moves quickly (in a vertical direc- 
tion) from the end of field I to the start of field II. This second flyback is 
called the vertical retrace. Field II is treated in the same fashion as field I. 
The time taken for each field to be scanned is 1/60 second. Correspond- 
ingly, the time taken for a frame or a complete picture to be scanned is 
1/30 second. With 525 lines in a frame, the line scanning frequency equals 
15.75 kHz. 

Thus, by flashing 30 still pictures per second on the display tube of the 
TV receiver, the human eye perceives them to be moving pictures. This 
effect is due to a phenomenon known as the persistence of vision. 

During the horizontal- and vertical-retrace intervals, the picture tube is 
made inoperative by means of blanking pulses that are generated at the 
transmitter. Moreover, synchronization between the various scanning op- 
erations at both the transmitter and receiver is accomplished by means of 
- special pulses that are transmitted during the blanking periods; as such, 
the synchronizing pulses do not show on the reproduced picture. Figure 
7.31 illustrates the use of blanking periods and synchronizing pulses for 
one full line of a video waveform. 
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Figure 7.31 
Video waveform for one full line of TV picture. 


Video Bandwidth ‘The reproduction quality of a TV picture is limited by 
two basic factors: 


1. The number of lines available in a raster scan, which limits resolution 
of the picture in the vertical direction. 

2. The channel bandwidth available for transmitting the video signal, which 
limits resolution of the picture in the horizontal direction. 


For each direction, resolution is expressed in terms of the maximum number 
of lines alternating between black and white that can be resolved in the 
TV image along the pertinent direction by a human observer. 

Consider first the image resolution in the vertical direction, denoted by 
R,. It is tempting to equate the vertical resolution R, to the total number 
of scan lines per frame minus those lines in the vertical interval that are 
not used for display. In practice, however, this is not so, because the 
scanning process that changes the image into a video signal in the camera 
(at the transmitter) and then reconstructs the image on the display (at the 
receiver) is in reality a sampling process. From our discussion of the sam- 
pling process in Section 5.3, we know that a message signal must be strictly 
band-limited or else distortion due to aliasing will occur. Consequently, 
we find that the vertical resolution in a TV picture is reduced not only by 
the vertical retrace, but also by aliasing, as shown by 


R, = k(N — 2N,,) (7.81) 
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where N is the total number of raster scan lines, and N, is the number of 
lines per field that are lost during the vertical retrace. The fact that the 
vertical resolution R, in Eq. 7.81 is a fraction of (N — 2N,,) is called the 
Kell effect; correspondingly, k is called the Kell factor. Normally, the Kell 
factor ranges between 0.6 and 0.7. 

Let a denote the raster height, as in Fig. 7.30. Then, we may express 
the vertical resolution in a TV picture in terms of vertical lines per unit 
distance as 


R, . a: 
= = E ow — 2N.,) lines/unit distance (7.82) 


Consider next the horizontal resolution, denoted as R,,; this resolution 
is expressed in terms of the maximum number of lines that can be resolved 
in a TV picture along the horizontal direction. To determine R,,. we assume 
that the picture elements or pixels are arranged as alternate black and 
white squares along the scanning line. The corresponding video signal is 
a square wave with a fundamental frequency equal to the video bandwidth. 
Since there are two pixels per cycle of the square wave, we may express 
the horizontal resolution of a TV picture as 


Rp = 2BCF"—_ fi) (7.83) 
where B is the video bandwidth, T is the total duration of one scanning 
line, and T, is the duration of a horizontal retrace. 

Let b denote the raster width, as in Fig. 7.30. We may then express the 


horizontal resolution of a TV picture in terms of horizontal lines per unit 
distance as 


a (T — T,,) lines/unit distance (7.84) 


A natural choice for the video bandwidth B is to make the vertical 
resolution equal the horizontal resolution, as shown by 


= = (7.85) 


Hence, using Eqs. 7.82, 7.84 and 7.85 to solve for the bandwidth B. we 


get the desired result 
RAEN = 2 NP 
S 7.85 


The ratio of raster width b to raster height a is called the aspect ratio. 
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In the NTSC° system, we have the following parameter values: 


Aspect ratio = 


alio 
Wl 


Total lines per frame = N = 525 
Vertical retrace = N,, = 21 lines/field 
Kell factor = k = 0.7 

Total line time = T = 63.5 us 
Horizontal retrace time = Tą = 10 us 


Substituting these values in Eq. 7.86, we get the video bandwidth: 
B = 4.21 MHz 


This result is very close to the actual maximum frequency in the standard 
video signal, which is 4.2 MHz. 


Choice of Modulation The type of modulation chosen to transmit the 
video signal is influenced by two factors: 


1. The video signal exhibits a large bandwidth and significant low-fre- 
quency content. This suggests the use of vestigial sideband modulation. 


2. The circuitry used for demodulation in the receiver should be simple 
and therefore cheap. This suggests the use of envelope detection, which 
requires the addition of a carrier to the VSB modulated wave. 


With regard to point 1, although there is a basic desire to conserve 
bandwidth, nevertheless in commercial TV broadcasting the transmitted 
signal is not quite VSB-modulated. The reason is that at the transmitter 
the power levels are high, with the result that it would be expensive to 
rigidly control the transition region. Instead, a VSB filter is inserted in 
each receiver where the power levels are low. The overall performance is 
the same as conventional vestigial-sideband modulation except for some 
wasted power and bandwidth. These remarks are illustrated in Fig. 7.32. 
In particular, part a of the figure shows the idealized specturm of a trans- 
mitted TV signal. The upper sideband, 25% of the lower sideband, and 
the picture carrier are transmitted. The frequency response of the VSB 
filter used to do the required spectrum shaping in the receiver is shown in 
part b of the figure. 

With regard to point 2, the use of envelope detection (applied to a VSB- 
modulated wave plus carrier) produces waveform distortion in the message 
signal recovered at the detector output. The distortion is contributed by 


NTSC is the abbreviation for National Television System Committee. 
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(a) Idealized amplitude spectrum of transmitted TV signal. (b) Amplitude response 
of VSB shaping filter in the receiver. 


the quadrature component of the VSB wave. This issue was discussed in 
Section 7.5. l 

The channel bandwidth used for NTSC TV broadcast is 6 MHz; see 
Fig. 7.32b. This channel bandwidth not only accommodates the bandwidth 
requirement of the VSB-modulated video signal but also provides for the 
accompanying sound signal that modulates a carrier of its own. 

The values presented on the frequency axis in parts (a) and (b) of Fig. 
7.32 pertain to a specific TV channel. According to this figure, the picture 
carrier frequency is at 55.75 MHz, and the sound carrier frequency is at 
59.75 MHz. Note, however, that the information content of the TV signal 
lies in a baseband spectrum extending from 1.25 MHz below the picture 
carrier to 4.5 MHz above it. 
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COLOR TELEVISION 


The transmission of color in commercial TV broadcasting is based on the 
premise that all colors found in nature can be approximated by mixing 
three additive primary colors: red, green, and blue. These three primary 
colors are represented by the video signals ma(t), mcg(t), and m,(t), re- 
spectively. To conserve bandwidth and also produce a picture that can be 
viewed on a conventional black-and-white (monochrome) television re- 
ceiver, the transmission of these three primary colors is accomplished by 
observing that they can be uniquely represented by any three signals that 
are independent linear combinations of ma(t), m¢(t), and m,(t). In the 
standard color-television system, the three signals that are transmitted have 
the form 


m(t) = 0.30mag(t) + 0.59m¢(t) + 0.11m,(t) 
m(t) = 0.60mg(t) — 0.28m¢(t) — 0.32m,(t) 
mMo(t) = 0.21ma(t) — 0.52m,(t) + 0.31m,(t) (7.87) 


The signal m,(t) is called the luminance signal; when received on a con- 
ventional monochrome television receiver, it produces a black-and-white 
version of the color picture. The signals m,(t) and mo(t) are called the 
chrominance signals; they indicate the way the color of the picture departs 
from shades of gray. With m,(t), m,(t), and mg(t) defined as before, we 
have by simultaneous solution: 


mp(t) = m,(t) — 0.96m,(t) + 0.62mo(t) 
mo(t) = m,(t) — 0.28m,(t) — 0.64mo(t) 
mp(t) = m,(t) — 1.10m,(t) + 1.70mọ(t) (7.88) 


The luminance signal m,(t) is assigned the entire 4.2 MHz bandwidth. 
Owing to certain properties of human vision, tests show that if the nominal 
bandwidths of the chrominance signals m,(t) and mo(t) are 1.6 MHz and 
0.6 MHz, respectively, then satisfactory color reproduction is possible. 

Figure 7.33a shows a simplified block diagram of the color-television 
transmitter. The chrominance signals m,(t) and mo(t) are combined using 
a variation of quadrature-multiplexing with a subcarrier having a frequency 
denoted by f«. The output resulting from the quadrature-multiplexing 
operation is next superimposed on the luminance signal m,(t) to give a 
combined video signal m(t). The composite video signal m(t) is thus de- 
scribed by 


m(t) = m(t) + m,(t) cos(2zf,.t) + Mo(t) sin(2zf,.t) 
+ M(t) sin(27f,.t) (7.89) 
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Figure 7.33 
(a) Block diagram of multiplexer in TV transmitter. (b) Block diagram of 
demultiplexer in TV receiver. 
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where 7t;;,(t) is the quadrature component, consisting of the Hilbert trans- 
form of the high-frequency portion of m,(t). The presence of /1,,(t) ac- 
counts for the presence of asymmetric sidebands. Naturally, f; (t) arises 
because of the built-in asymmetric nature of the band-pass filter that passes 
frequencies in the band 2.0-4.2 MHz; see Fig. 7.33a. 

The standard blanking and synchronizing pulses are added to the video 
signal m(t). In addition, a “burst” of 8 cycles of the subcarrier is super- 
imposed on the trailing portion or “back porch” of the horizontal blanking 
pulses for color subcarrier synchronization at the receiver. 

The chrominance subcarrier frequency f,.. is equal to 455/2 times the 
horizontal-sweep frequency or line-scanning frequency f,. In color TV, f, 
is 4.5 MHz/286. Hence, 


455 
fee = oS h 


3.579545 MHz 


For brevity, the value of f,. in Fig. 7.33 (and hereafter) is approximated 
as 3.58 MHz. The frequency f.. serves as the frame of reference in color 
TV in the sense that the reference signals for the color demodulators in 
the receiver are obtained from a crystal-controlled oscillator of frequency 
fæ- This oscillator is synchronized to the burst of the subcarrier in the 
transmitted TV signal by means of a phase-locked loop; the phase-locked 
loop is described in Section 7.12. 

At the receiver, demultiplexing of the video signal m(t) into the three 
primary color signals is performed after envelope detection. Figure 7.33b 
is a block diagram of the demultiplexing system. Since the luminance signal 
m,(t) constitutes a baseband component of the video signal m(t), it re- 
quires no further processing (except for the use of a 3.58 MHz rejection 
filter needed to suppress a flicker component at the subcarrier frequency). 
Moreover, assuming perfect synchronization, we can recover the remaining 
baseband components m,(t) and mo(t) by means of the coherent detectors 
whose local carriers are in phase quadrature. Thus, given m,(t), m(t), 
and mo(t), we can generate the original primary color signals ma(t), mc(t) 
and m,(t) by using the matrixer shown at the output of Fig. 7.33b. The 
operation of the matrixer is described by Eq. 7.88. 


HIGH-DEFINITION TELEVISION 


In a high-definition television (HDTV) system,’ the image quality is im- 
proved by a quantum leap as compared to the NTSC system. In particular, 


7From a historical perspective, research into high-definition wide-screen television 
Started in Japan in 1968; the outstanding contributor here is Takashi Fugio. The 
material presented herein is based on Rzeszewski (1983). This paper and several 
others on HDTV are reproduced in Rzeszewski (1985). 
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HDTV offers the following improvements: 


1. Improved vertical resolution. 
2. Improved horizontal resolution. 
3. Less crosstalk between the components of the signal. 


The improved image quality together with a large screen size provides the 
viewer with a feeling of realism and involvement that is unattainable oth- 
erwise. 

However, for HDTV to be widely acceptable, two requirements are 
critical. First, there should be receiver compatibility, which means that the 
signal must be able to feed an HDTV and NTSC TV simultaneously and 
be received on the NTSC receiver with substantially the same picture 
quality as that achievable by conventional means. Meanwhile, the HDTV 
receiver realizes the full benefits, including increased resolution. Second, 
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a bandwidth of no more than twice the 6 MHz per channel for NTSC TV 
broadcast should be required. 

Figure 7.34a shows the baseband format of a split-luminance and split- 
chrominance (SLSC) type of transmission system that satisfies both of these 
requirements. It uses a 10-MHz baseband composite signal that can be 
transmitted as a vestigial sideband modulated wave in a channel bandwidth 
of 12 MHz. Also, an NTSC receiver (tuned to the lower 6 MHz portion 
of the 12 MHz spectrum) will operate with the same quality achieved in a 
conventional system. Figure 7.34b shows the baseband version of the am- 
plitude response of an idealized broadcast picture transmission system, 
measured with respect to the picture carrier frequency. 

The composite signal of Fig. 7.34a is obtained by starting with a 1050- 
line scan source of high-bandwidth red, green, blue (R, G, B) signals. 
These signals are filtered and converted to a 525-line signal by a scan 
conversion technique that deletes every second line to obtain a 525-line 
signal suitable for transmission. Improved horizontal resolution is provided 
for by the use of the second 525-line signal that occupies a frequency range 
of approximately 5 to 10 MHz in the baseband. The baseband spectrum 
of Fig. 7.34a also includes provision for an additional signal for improved 
chrominance resolution. 

Improved vertical resolution is catered to by using twice as many scan 
lines as in NTSC. Moreover, the method of vertical resolution improvement 
permits the Kell factor to approach unity. 


7.10 ANGLE MODULATION: BASIC CONCEPTS 


In the previous sections of this chapter we investigated the effect of slowly 
varying the amplitude of a sinusoidal carrier wave in accordance with the 
baseband information-bearing signal. There is another method of modu- 
lating a sinusoidal carrier wave, namely, angle modulation in which either 
the phase or frequency of the carrier wave is varied according to the message 
signal. In this method of modulation the amplitude of the carrier wave is 
maintained constant. 

We begin our study of angle modulation by writing the modulated wave 
in the general form 


s(t) = A, cos[O(t)] (7.90) 


where the carrier amplitude A, is maintained constant, and the angular 
argument @(t) is varied by a message signal m(t). The mathematical form 
of this variation is determined by the type of angle modulation of interest. 
In any event, a complete oscillation occurs whenever O(t) changes by 27 
radians. If (t) increases monotonically with time, the average frequency 
in hertz, over an interval from ¢ to t + 4t, is given by 


Olt + At) = 0) 


Fall) = TE 


(7.91) 


ANGLE MODULATION: BASIC CONCEPTS 323 


We define the instantaneous frequency of the angle-modulated wave s(t) 
by 


fi(t) 


lim f 4/(t) 
4t>0 


Jee E + At) — 0| 
t0 2n At 

_ 1 do) 

So ae (7.92) 


Thus, according to Eq. 7.90, we may interpret the angle-modulated 
wave s(t) as a rotating phasor of length A, and angle @(t). The angular 
velocity of such a phasor is d6(t)/dt, in accordance with Eq. 7.92. In the 
simple case of an unmodulated carrier, the angle 0(£) is 


Olt) = 2nf.t + Q. 


and the corresponding phasor rotates with a constant angular velocity equal 
to 2zf,. The constant ¢, is the value of O(t) at t = 0. 

There are an infinite number of ways in which the angle 6(t) may be 
varied in some manner with the message signal. However, we will consider 
only two commonly used methods, phase modulation and frequency mod- 
ulation, as next defined: 


1. Phase modulation (PM) is that form of angle modulation in which the 
angular argument 0(t) is varied linearly with the message signal m(t), as 
shown by 

O(t) = 2nf,t + k,m(t) (7.93) 
The term 2zf,t represents the angular argument of the unmodulated 
carrier, and the constant k, represents the phase sensitivity of the mod- 
ulator, expressed in radians per volt. This assumes that m(t) is a voltage 
waveform. For convenience, we have assumed in Eq. 7.93 that the 
angular argument of the unmodulated carrier is zero at t = 0. The 
phase-modulated wave s(t) is thus described in the time domain by 
s(t) = A, cos[2zf.t + k,m(t)] (7.94) 

2. Frequency modulation (FM) is that form of angle modulation in which 
the instantaneous frequency f (t) is varied linearly with the message signal 
m(t), as shown by 

fi) = fe + kym(t) (7.95) 
The term f, represents the frequency of the unmodulated carrier, and 
the constant k; represents the frequency sensitivity of the modulator, 
expressed in hertz per volt. This assumes that m(¢) is a voltage wave- 
form. Integrating Eq. 7.95 with respect to time and multiplying the 
result by 27, we get 


A(t) = 2xf.t + Ink, | ‘ m(t) dt (7.96) 
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where, for convenience, we have assumed that the angular argument 
of the unmodulated carrier wave is zero at t = 0. The frequency-mod- 
ulated wave is therefore described in the time domain by 


Can cos| 2h + Ink; | nO a (7.97) 


A consequence of allowing the angular argument 0(t) to become de- 
pendent on the message signal m(t) as in Eq. 7.93 or on its integral as in 
Eq. 7.96 is that the zero crossings of a PM wave or FM wave no longer 
have a perfect regularity in their spacing; zero crossings refer to the instants 
of time at which a waveform changes from a negative to a positive value 
or vice versa. This is one important feature that distinguishes both PM and 
FM waves from an AM wave. Another important difference is that the 
envelope of a PM or FM wave is constant (equal to the carrier amplitude), 
whereas the envelope of an AM wave is dependent on the message signal. 

Comparing Eq. 7.94 with 7.97 reveals that an FM wave may be regarded 
as a PM wave in which the modulating wave is fj m(t) dt in place of m(t). 
This means that an FM wave can be generated by first integrating m(t) 
and then using the result as the input to a phase modulator, as in Fig. 
7.35a. Conversely, a PM wave can be generated by first differentiating 
m(t) and then using the result as the input to a frequency modulator, as 
in Fig. 7.355. We may thus deduce all the properties of PM waves from 
those of FM waves, and vice versa. 
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Figure 7.35 

The relationship between frequency modulation and phase modulation. (a) Scheme 
for generating an FM wave by using a phase modulator. (b) Scheme for generating 
a PM wave by using a freguency modulator. 
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EXAMPLE 6 SINUSOIDAL MODULATION 


Consider a sinusoidal modulating wave m(t), two full cycles of which are 
plotted in Fig. 7.36a. The FM wave produced by this modulating wave is 
plotted in Fig. 7.36b. 

To determine the PM wave for m(t), we note that it is the same as the 
FM wave produced by dm(t)/dt, the derivative of m(t) with respect to time 
(see Fig. 7.35b). In Fig. 7.36c, we plot the derivative dm(t)/dt, which 
consists of the original sinusoidal modulating wave shifted in phase by 90°. 
The desired PM wave is plotted in Fig. 7.36d. 
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Figure 7.36 
(a) Sinusoidal modulating wave m(t). (b) Frequency-modulated wave. (c) Derivative 
of m(t) with respect to time. (d) Phase-modulated wave. 
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From the waveforms of Fig. 7.36, we see that for sinusoidal modulation 
a distinction between FM and PM waves can be made only by comparing 
with the actual modulating waves. 
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EXAMPLE 7 SQUARE MODULATION 


Consider next a square modulating wave m(t), two full cycles of which are 
shown plotted in Fig. 7.37a. The FM wave ig by this modulating 
wave is plotted in Fig. 7.37b. 

To plot the PM wave produced by the square modulating wave m(t), 
we follow a procedure similar to that in Example 6. Specifically, the de- 
rivative dm(t)/dt is plotted in Fig. 7.37c; it consists of a periodic sequence 
of alternating delta functions. The desired PM wave is plotted in Fig. 7.37d. 

Unlike the case of sinusoidal modulation, we see that for square mod- 
ulation the FM and PM waves are distinctly different from each other. 


(a) 


: —> time —> time : 


: Figure 7.37 
: (a) Square modulating wave mit). (b) Frequency-modulated wave. (c) Derivative of 
: m(t) with respect to time. (d) Phase-modulated wave. 


EXERCISE 15 An FM wave is defined by 
s(t) = A, cos[10zt + sin(4zz)] 


Find the instantaneous frequency of s(t). 
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EXERCISE 16 The square wave of Fig. 7.37a is applied to the scheme 
Shown in Fig. 7.35a. Plot the waveforms at the aout and output of the 


peoseoesccosccosece 


phase modulator i in Fig. 35a. 


7.11 FREQUENCY MODULATION 


The FM wave s(t) defined by Eq. 7.97 is a nonlinear function of the 
modulating wave m(t). Hence, frequency modulation is a nonlinear mod- 
ulation process. Consequently, unlike amplitude modulation, the spectrum 
of an FM wave is not related in a simple manner to that of the modulating 
wave. Thus, in order to study the spectral properties of an FM wave, the 
traditional approach is to start with single-tone modulation and build on 
the knowledge thus gained. 


SINGLE-TONE FREQUENCY MODULATION 


Consider then a sinusoidal modulating wave defined by 
m(t) = Am COS(27f mt) (7.98) 
The instantaneous frequency of the resulting FM wave equals 


fi(t) = fe + kjAm CoS(27f nt) 
= fo Ay COSC RAL) (7.99) 


where 


Af = k;Ap (7.100) 


The quantity 4f is called the frequency deviation, representing the maxi- 
mum departure of the instantaneous frequency of the FM wave from the 
carrier frequency f.. A fundamental characteristic of an FM wave is that 
the frequency deviation 4f is proportional to the amplitude of the mod- 
ulating wave and is independent of the modulation frequency. 

Using Eq. 7.99, the regular argument 6(t) of the FM wave is obtained 
as 


a(t) = 2n | FO at 


= 2nf.t + 2 sin(27f t) (7.101) 


328 MODULATION TECHNIQUES 


The ratio of the frequency deviation 4f to the modulation frequency fm 
is commonly called the modulation index of the FM wave. We denote it 
by £, so that we may write 


re 


pa (7.102) 


and 
O(t) = 2nf,t + Bsin(2zf,,t) (7.103) 


From Eq. 7.103 we see that, in a physical sense, the parameter £ represents 
the phase deviation of the FM wave; that is, the maximum departure of 
the angular argument 6(¢) from the angle 27 f .t of the unmodulated carrier. 


EXERCISE 17 A sinusoidal modulating wave of amplitude 5 V and fre- 
quency 1 kHz is applied to a frequency modulator. The frequency sensitivity 
of the modulator is 40 Hz/V. The carrier frequency is 100 kHz. Calculate 
(a) the frequency deviation, and (b) the modulation index. 


SPECTRUM ANALYSIS OF SINUSOIDAL FM WAVE 


The FM wave for sinusoidal modulation is given by 
s(t) = A, cos[2zf,t + B sin(2zf,,t)] (7.104) 


Using a well-known trigonometric identity, we may expand this relation 
as 


s(t) = A, cos(2zf,t) cos[B sin(2zf,,t)] 
— A, sin(2zf,t) sin[f sin(2zf,,t)] (7.105) 


From this expanded form, we see that the in-phase and quadrature com- 


ponents of the FM wave s(t) for the case of sinusoidal modulation are as 
follows: 


5,(t) = A, cos[B sin(2zf,,t)] (7.106) 
So(t) = A. sin[P sin(2zf,,t)] (7.107) 
Hence, the complex envelope of the FM wave equals 


S(t) = s(t) + jso(t) 
= A, exp[jf sin(2zf,,t)] (7.108) 
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The complex envelope S(t) retains complete information about the mod- 
ulation process. Indeed, we may readily express the FM wave s(t) in terms 
of the complex envelope §(t) by writing 


s(t) = Re[A, exp(j2zf,t + jB sin(2zf,,t))] 
Re[S(t) exp(j2zf.t)] (7.109) 


From Eq. 7.108 we see that the complex envelope is a periodic function 
of time, with a fundamental frequency equal to the modulation frequency 
fm. We may therefore expand S(t) in the form of a complex Fourier series 
as follows 


§(t) = > c, EXpP(j2nNfmt) (7.110) 


n=—% 


where the complex Fourier coefficient c, equals 


3,08 i "He S(t) exp(—j2nnfint) dt 
i m 


-1/2f 


St Í Pe E a a aoe 
=172f,, 


For convenience, we define the variable 
x = 27f mt (7.112) 


in terms of which we may rewrite Eq. 7.111 as 
A, fE Dae: 
C = = exp[j(f sinx — nx)] dx (7.113) 


The integral on the right side of Eq. 7.113 is recognized as the nth order 
Bessel function of the first kind and argument $ (see Appendix B). This 
function is commonly denoted by the symbol J„(£); that is, 


J, ($) = - i exp[j(£ sinx — nx)] dx (7.114) 


Hence, we may rewrite Eq. 7.113 as 


Cn = A.J, (B) (7.115) 
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Substituting Eq. 7.115 in 7.110, we get, in terms of the Bessel function 
J,(B), the following expansion for the complex envelope of the FM wave: 


s(t) = A. SS In(B) exp j2nnfgt (7.116) 


n=— 


Next, substituting Eq. 7.116 in 7.109, we get 


SO = Ac Re| D IO plj + nha) | (7.117) 


Interchanging the order of summation and evaluating the real part of the 
right side of Eq. 7.117, we get 


s(t) = Ae D JaC) cosl2n(fe + nfa)t] 118) 


n=-% 


This is the desired form for the Fourier series representation of the single- 
tone FM wave s(t) for an arbitrary value of $. The discrete spectrum of 
s(t) is obtained by taking the Fourier transforms of both sides of Eq. 7.118; 
thus 


S(f) = FD IS = fo = nfn) + OCF + fe + fad) (7.119) 


In Fig. 7.38 we have plotted the Bessel function J,(f) versus the mod- 
‘ulation index £ for n = 0, 1, 2, 3, 4. These plots show that for fixed n, 
J,(B) alternates between positive and negative values for increasing £ and 
that |J,(8)| approaches zero as £ approaches infinity. Note also that for 
fixed f, we have 


ORE Cae (7.120) 


Accordingly, we need only plot or tabulate J,(f) for positive values of 
order n. 

From Eqs. 7.97 and 7.118, we deduce the following properties of FM 
waves: 


PROPERTY 1: NARROW-BAND FM 


For small values of the modulation index B compared to one radian, the FM 
wave assumes a narrow-band form consisting essentially of a carrier, an 
upper side-frequency component, and a lower side-frequency component. 
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Figure 7.38 
Plots of Bessel functions of the first kind. 


This property follows from the fact that for small values of 8, we have 


Jo(B) = 1 
Ji(B) ~£ 
J,(B) = 0, n> 1 (7.121) 


The approximations indicated in Eqs. 7.121 are closely justified for values 
of the modulation index defined by £ < 0.3 rad. Thus, substituting Eqs. 
7.121 in 7.118, we get 


s(t) = A, cos(27f,.t) + lA cos[2z(f. + fm)t] 


2 
PA: cosl2n(fe = fn) (1.122) 


This equation shows that for small J, the FM wave s(t) may be closely 
approximated by the sum of a carrier of amplitude A., an upper side- 


332 MODULATION TECHNIQUES 


frequency component of amplitude BA,/2, and a lower side-frequency 
component of amplitude BA ,/2 and phase-shift equal to 180° (represented 
by the minus sign in Eq. 7.122). An FM wave so characterized is said to 
be narrow-band. 


EXERCISE 18 In what ways do a standard AM wave and a ee ! 
FM wave dier from each other? i 


PROPERTY 2: WIDEBAND FM 


For large values of the modulation index 8B compared to one radian, the FM 
wave (in theory) contains a carrier and an infinite number of side-frequency 
components located symmetrically around the carrier. 


This second property is a restatement of Eq. 7.118 with no approximations 
made. An FM wave thus defined is said to be wideband. Note that the 
amplitude of the carrier component contained in a wideband FM wave 
varies with the modulation index £ in accordance with J)(f). 


‘ . EXERCISE 19° i what ways do a standard AM wave and a a FM is 
wave differ from each pher es 


PROPERTY 3: CONSTANT AVERAGE POWER 


The envelope of an FM wave is constant, so that the average power of such 
a wave dissipated in a 1-ohm resistor is also constant. 


This property follows directly from the definition given in Eq. 7.97 for an 
FM wave. Specifically, the FM wave s(t) defined in Eq. 7.97 has a constant 
envelope equal to A,. Accordingly, the average power dissipated by s(t) 
in a 1-ohm resistor is given by 


PEA (7.123) 


This result may also be derived from Eq. 7.118. In particular, we note 
from the series expansion of Eq. 7.118 that the average power of a single- 
tone FM wave s(t) may be expressed in the form of a corresponding series 
as: 


= T 5 PR (7.124) 


n=-% 
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Next, we note that (see Appendix B) 


S 2p) =1 (7.125) 


n=— 


Thus, substituting Eq. 7.125 in 7.124, we get the result given in Eq. 7.123. 
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EXAMPLE 8 


We wish to investigate the ways in which variations in the amplitude and 
frequency of a sinusoidal modulating wave affect the spectrum of the FM 
wave. Consider first the case when the frequency of the modulating wave 
is fixed, but its amplitude is varied, producing a corresponding variation 
in the frequency deviation 4f. Thus, keeping the modulation frequency 
fm fixed, we find that the amplitude spectrum of the resulting FM wave is 
as plotted in Fig. 7.39 for f = 1, 2, and 5. In this diagram we have 


B= 1.0 


OSS OO SOOO SESE SE OO SSOP OTST OEEOOOOSSSESS OO SOTTOTOSHSSOOTTOUSOOO FOR ESOO TSO SOO OSSOCOOTOTODOSE OSES 


(a) 
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Figure 7.39 

Discrete amplitude spectra of an FM signal, normalized with respect to the carrier 
amplitude, for the case of sinusoidal modulation of fixed frequency and varying 
amplitude. Only the spectra for positive frequencies are shown. 
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Figure 7.39 (continued) 
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Figure 7.40 (continued) 


normalized the spectrum with respect to the unmodulated carrier ampli- 
tude. 

Consider next the case when the amplitude of the modulating wave is 
fixed; that is, the frequency deviation 4f is maintained constant and the 
modulation frequency fm is varied. In this case we find that the amplitude 
spectrum of the resulting FM wave is as plotted in Fig. 7.40 for 6 = 1, 2, 
and 5. We see that when 4 f is fixed and £ is increased, we have an increasing 
number of spectral lines crowding into a fixed frequency interval defined 
by f. —- Af < f < fe + Af. That is, when £ approaches infinity, the 
bandwidth of the FM wave approaches the limiting value of 2 4f. 


e 
Foe ee OOO SE OTTO OHO OOS HE EOHORO ESTOS OAEETO DOTS SSOP OSSEO SDS OOOSOF OSES OS ODOSOTSSOOSSOOEOOOSODOOOOOROSOHESALOSS ESS OODOOOROSEOOES 


EXERCISE 20 Expand the discrete amplitude spectra shown in Figs. 7.39 
and 7.40 by including the spectrum of an FM wave with £ = 0.2. 


TRANSMISSION BANDWIDTH OF FM WAVES 


In theory, an FM wave contains an infinite number of side-frequencies so 
that the bandwidth required to transmit such a signal is similarly infinite 
in extent. In practice, however, we find that the FM wave is effectively 
limited to a finite number of significant side-frequencies compatible with 
a specified amount of distortion. We may therefore specify an effective 
bandwidth required for the transmission of an FM wave. Consider first the 
case of an FM wave generated by a single-tone modulating wave of fre- 
quency f,,. In such an FM wave, the side-frequencies that are separated 
from the carrier frequency f, by an amount greater than the frequency 
deviation 4f decrease rapidly toward zero, so that the bandwidth always 
exceeds the total frequency excursion, but nevertheless is limited. Specif- 
ically, for large values of the modulation index f, the bandwidth ap- 
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proaches, and is only slightly greater than the total frequency excursion 
2 Af. On the other hand, for small values of the modulation index f, the 
spectrum of the FM wave is effectively limited to the carrier frequency f. 
and one pair of side-frequencies at fe + fm, so that the bandwidth ap- 
proaches 2f,,. We may thus define an approximate rule for the transmission 
bandwidth of an FM wave generated by a single-tone modulating wave of 
frequency fm as 


B=24f + 2m =245(1 +4) (7.126) 


This relation is known as Carson’s rule. 

For a more accurate assessment of the bandwidth requirement of an 
FM wave, we may use a definition based on retaining the maximum number 
of significant side-frequencies with amplitudes all greater than some se- 
lected value. A convenient choice for this value is 1% of the unmodulated 
carrier amplitude. We may thus define the 99 percent bandwidth of an FM 
wave as the separation between the two frequencies beyond which none of 
the side-frequencies is greater than 1% of the carrier amplitude obtained 
when the modulation is removed. That is, we define the transmission band- 
width as 2Amaxfm, Where fm is the modulation frequency and n,,,, is the 
maximum value of the integer n that satisfies the requirement |J,(f)| > 0.01. 
The value of nma varies with the modulation index $ and can be determined 
readily from tabulated values of the Bessel function J,(8). Table 7.2 shows 
the total number of significant side-frequencies (including both the upper 
and lower side-frequencies) for different values of £, calculated on the 1% 
basis just explained. The transmission bandwidth B calculated using this 
procedure can be presented in the form of a universal curve by normalizing 
it with respect to the frequency deviation 4f, and then plotting it versus 


TABLE 7.2 
i oe index — of significant side-frequencies 
Nmax 

0.1 2 
0.3 4 
0.5 4 
1.0 6 
2.0 8 
5.0 16 

10.0 28 

20.0 50 

30.0 70 


B/Af 
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B. This curve is shown in Fig. 7.41, which is drawn as a best fit through 
the set of points obtained by using Table 7.2. In Fig. 7.41 we note that as 
the modulation index £ is increased, the bandwidth occupied by the sig- 
nificant side-frequencies drops toward that over which the carrier frequency 
actually deviates. This means that small values of the modulation index £ 
are relatively more extravagant in transmission bandwidth than are the 
larger values of £. 

Consider next an arbitrary modulating wave m(t) with its highest fre- 
quency component denoted by W. The bandwidth required to transmit an 
FM wave generated by this modulating wave is estimated by using a worst- 
case tone-modulation analysis. Specifically, we first determine the so-called 
deviation ratio D, defined as the ratio of the frequency deviation 4 f, which 
corresponds to the maximum possible amplitude of the modulating wave 
m(t), to the highest modulation frequency W; these conditions represent 
the extreme cases possible. The deviation ratio D plays the same role for 
nonsinusoidal modulation that the modulation index ß plays for the case of 
sinusoidal modulation. Then, replacing $ by D and replacing f,,, by W, we 
use Carson’s rule given by Eq. 7.126 or the universal curve of Fig. 7.41 to 
obtain a value for the transmission bandwidth of the FM wave. From a 
practical viewpoint, Carson’s rule somewhat underestimates the bandwidth 
requirement of an FM system, whereas using the universal curve of Fig. 
7.41 yields a somewhat conservative result. Thus the choice of a trans- 


Figure 7.41 
Universal curve for evaluating the 99% bandwidth of an FM wave. 
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mission bandwidth that lies between the bounds provided by these two 
rules of thumb is acceptable for most practical purposes. 


EXAMPLE 9 


In North America, the maximum value of frequency deviation 4 f is fixed 
at 75 kHz for commercial FM broadcasting by radio. If we take the mod- 
ulation frequency W = 15 kHz, which is typically the maximum audio 
frequency of interest in FM transmission, we find that the corresponding 
value of the deviation ratio is 


E- 


D= 75> 


5 


Using Carson’s rule of Eq. 7.126, replacing f by D and replacing fm by W, 
the approximate value of the transmission bandwidth of the FM wave is 
obtained as 


B = 2(75 + 15) = 180 kHz 


On the other hand, use of the curve of Fig. 7.41 gives the transmission 
bandwidth of the FM wave to be 


B = 3.2 Af = 3.2 x 75 = 240 kHz 


Thus Carson’s rule underestimates the transmission bandwidth by 25% 
compared with the result of using the curve of Fig. 7.41. 


EXERCISE 21 Repeat the calculations of Example 9, assuming that the 
frequency deviation is decreased to 50 kHz. 


GENERATION OF FM WAVES 


There are essentially two basic methods of generating frequency-modulated 
waves, namely, indirect FM and direct FM. In the indirect method of 
producing frequency modulation,® the modulating wave is first used to 
produce a narrow-band FM wave, and frequency multiplication is next used 


*The indirect method of generating a wideband FM wave was first proposed by 
Armstrong. A frequency modulator so designed is sometimes referred to as the 
Armstrong modulator; see Armstrong (1936). Armstrong was also the first to 
recognize the noise-cleaning properties of frequency modulation. 
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to increase the frequency deviation to the desired level. On the other hand, 
in the direct method of producing frequency modulation the carrier fre- 
quency is directly varied in accordance with the incoming message signal. 
In this subsection, we describe the important features of both methods. 


Indirect FM Consider first the generation of a narrow-band FM wave. To 
do this, we begin with the expression for an FM wave s,(t) for the general 
case of a modulating wave m(t), which is written in the form 


5,(t) = A, cos[2zf,t + $,(0)] (72127) 


where f, is the carrier frequency and A, is the carrier amplitude. The 
angular argument @¢,(t) of s,(t) is related to m(t) by 


Hili) = Inky | me) at (7.128) 


( 


where k; is the frequency sensitivity of the modulator. Provided that the 
angle ¢,(t) is small compared to one radian for all t, we may use the 
following approximations: 


cos[P(t)] = 1 (7.129) 
sin[P(t)] =~ $(¢) (7.130) 


Correspondingly, we may approximate Eq. 7.127 as follows 


sı(t) = A, cos(2zxf,t) — A, sin(27f,t)d,(t) 
= A, cos(2nf,t) — 2nk,A, sin(2zf,t) i ‘m(t) dt (7.131) 
0 


Equation 7.131 defines a narrow-band FM wave. Indeed, we may use this 
equation to set up the scheme shown in Fig. 7.42a for the generation of a 
narrow-band FM wave; the scaling factor 27k, is taken care of by the 
product modulator. Moreover, bearing in mind the relationship that exists 
between frequency modulation and phase modulation (see Fig. 7.35), we 
see that the part of the frequency modulator that lies inside the dashed 
rectangle in Fig. 7.42a represents a narrow-band phase modulator. 

The modulated wave produced by the narrow-band modulator of Fig. 
7.42a differs from an ideal FM wave in two respects: 


1. The envelope contains a residual amplitude modulation and, therefore, 
varies with time. a 
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Figure 7.42 
Block diagrams for (a) narrow-band frequency modulator, (b) frequency multiplier, 
and (c) wideband frequency modulator. 


2. For a sinusoidal modulating wave, the phase of the FM wave contains 
harmonic distortion in the form of third- and higher-order harmonics 
of the modulation frequency fm. 


However, by restricting the modulation index to 8 < 0.3 rad, the effects 
of residual AM and harmonic PM are limited to negligible levels. 

The next step in the indirect FM method is that of frequency multipli- 
cation. Basically, a frequency multiplier consists of a nonlinear device (e.g., 
diode or transistor) followed by a band-pass filter, as in Fig. 7.42b. The 
nonlinear device is assumed to be memoryless, which means that there is 
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no energy storage. In general, a memoryless nonlinear device is represented 
by the input-output relation? 


S(t) = a,5,(t) + as? (t) + +++ + asi (t) (7.132) 


where a), @,..., a, are constant coefficients. Substituting Eq. 7.131 in 
7.132, expanding and then collecting terms, we find that the output s(t) 
has a dc component and n frequency-modulated waves with carrier fre- 
quencies fı, 2f;, ..., mf, and frequency deviations 4f,;, 24f;,..., 
nAf,, respectively. The value of Af, is determined by the frequency sen- 
sitivity k, of the narrow-band frequency modulator and the maximum 
amplitude of the modulating wave m(t). We now see the motivation for 
using the band-pass filter in Fig. 7.42b. Specifically, the filter is designed 
with two aims in mind: 


1. To pass the FM wave centered at the carrier frequency nf, and with 
frequency deviation n 4f,. 


2. To suppress all other FM spectra. 


Thus, connecting the narrow-band frequency modulator and the fre- 
quency multiplier as depicted in Fig. 7.42c, we may generate a wideband 
FM wave s(t) with carrier frequency fe = nf, and frequency deviation 
Af = n Af), as desired. Specifically, we may write 


WO = Al cos| Unf + Ink; f m a (7.133) 


where 
k; = nk, (7.134) 


In other words, the wideband frequency modulator of Fig. 7.42c has a 
frequency sensitivity n times that of the narrow-band frequency modulator 
of Fig. 7.42a, where n is the frequency multiplication ratio. In Fig. 7.42c 
we show a crystal-controlled oscillator as the source of carrier; this is done 
for frequency stability. 


8Nonlinearities, in one form or another, are present in all electrical networks. There 
are two basic forms of nonlinearity to consider: 


1. The nonlinearity is said to be strong when it is introduced intentionally and in a 
controlled manner for some specific application. Examples of strong nonlinearity 
include frequency multipliers, amplitude limiters, and square-law modulators. 

2. The nonlinearity is said to be weak when a linear performance is desired, and 
any nonlinearities are viewed as parasitic in nature. The effect of such weak 
nonlinearities is to limit the useful signal levels in a system. Thus, weak 
nonlinearities become an important design consideration; see Problem 40. 
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EXERCISE 22 Consider a frequency multiplier that uses a square-law. 
device defined by : ‘i 


So(t) = ası (t) + azs4(6) | 


Specify the midband frequency and bandwidth of the band-pass filter used 
in the frequency multiplier for the resulting frequency deviation to be twice : 
that at the input of the nonlinear device. ae 


EXERCISE 23 An FM wave with a frequency deviation of 10 kHz at a 
‘modulation frequency of 5 kHz is applied to two frequency multipliers 
connected in cascade. The first multiplier doubles the frequency and the 
second multiplier triples the frequency. Determine the frequency deviation 
and the modulation index of the FM wave obtained at the second multiplier 
output. What is the frequency separation of the adjacent side-frequencies 
of this FM wave? ar 


zeeeeccoccoecccocococcecosacoooocececoooccosooosoococosocoosoooocoooocoosdscotoosoocooseeoonooooooeeooooteo0ooocooootoeooeooo 
e 


EXAMPLE 10 


Figure 7.43 shows the simplified block diagram of a typical FM transmitter 
(based on the indirect method) used to transmit audio signals containing 
frequencies in the range 100 Hz to 15 kHz. The narrow-band phase mod- 
ulator is supplied with a carrier wave of frequency fı = 0.1 MHz by a 
crystal-controlled oscillator. The desired FM wave at the transmitter output 
hasa carrier frequency f. = 100 MHzand frequency deviation4 f = 75 kHz. 

In order to limit the harmonic distortion produced by the narrow-band 
phase modulator, we restrict the modulation index £; to a maximum value 
of 0.3 rad. Suppose then $, = 0.2 rad. 

From Eq. 7.102, we see that for sinusoidal modulation, the frequency 
deviation equals the modulation index multiplied by the modulation fre- 
quency. Hence, for a fixed modulation index, the lowest modulation fre- 
quencies will limit the frequency deviation at the narrowband phase mod- 
ulator output. Thus, with £, = 0.2, the 100-Hz modulation frequencies 
will limit the frequency deviation Af, to 20 Hz. 

To produce a frequency deviation of Af = 75 kHz at the FM transmitter 
output, the use of frequency multiplication is required. Specifically, with 
Af, = 20 Hzand 4f = 75 kHz, we require a total frequency multiplication 
ratio of 3750. However, using a straight frequency multiplication equal to 
this value would produce a much higher carrier frequency at the transmitter 
output than the desired value of 100 MHz. To generate an FM wave having 
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Figure 7.43 
Block diagram of the wideband frequency modulator for Example 10. 


both the desired frequency deviation and carrier frequency, we therefore 
need to use a two-stage frequency multiplier with an intermediate stage of 
frequency translation, as illustrated in Fig. 7.43. 

Let n; and n, denote the respective frequency multiplication ratios, so 
that 


Af _ 75,000 
Aa 


Ayn, = 


= 3750 (7.135) 


The carrier frequency at the first frequency multiplier output is translated 
downward in frequency to (f — ,f,) by mixing it with a sinusoidal wave 
of frequency f, = 9.5 MHz, which is supplied by a second crystal-controlled 
oscillator. However, the carrier frequency at the input of the second fre- 
quency multiplier is equal to f./n2. Equating these two frequencies, we 
get 


er eee 


ny 
Hence, with fı = 0.1 MHz, f = 9.5 MHz, and f. = 100 MHz, we have 


100 
9.5 — 0.1m = — (7.136) 


n2 
Solving Eqs. 7.135 and 7.136 for n, and n2, We obtain 


n, = 75 
n, = 50 


Using these frequency multiplication ratios, we get the set of values in- 
dicated in Table 7.3. 


Narrow-band Frequency Frequency | FM signal : 
Integrator phase multiplier multiplier 
modulator 


eeercvccccsscecs 
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TABLE 7.3 Values of Carrier Frequency and Frequency Deviation at the Various 
Points in the Frequency Modulator of Fig. 7.43. 


At the first At the second 
At the phase frequency At the frequency 
modulator multiplier mixer multiplier 
output output output output 
Carrier 0.1 MHz 7.5 MHz 2.0 MHz 100 MHz 
frequency 
Frequency 20 Hz 1.5 kHz 1.5 kHz 75 kHz 
deviation 


Direct FM In the direct method of FM generation, the instantaneous fre- 
quency of the carrier wave is varied directly in accordance with the message 
signal by means of a device known as a voltage-controlled oscillator. One 
way of implementing such a device is to use a sinusoidal oscillator having 
a relatively high-Q frequency-determining network and to control the os- 
cillator by incremental variation of the reactive components. An example 
of this scheme is shown in Fig. 7.44, showing a Hartley oscillator. We 
assume that the capacitive component of the frequency-determining net- 
work consists of a fixed capacitor shunted by a voltage-variable capacitor. 
The resultant capacitance is represented by C(t) in Fig. 7.44. A voltage- 
variable capacitor, commonly called a varactor or varicap, is one whose 
capacitance depends on the voltage applied across its electrodes. The vari- 
able-voltage capacitance may be obtained, for example, by using a p-n 
junction diode that is biased in the reverse direction; the larger the reverse 
voltage applied to such a diode, the smaller the transition capacitance of 
the diode. The frequency of oscillation of the Hartley oscillator of Fig. 
7.44 is given by 


1 
vr 21 


V(L; + L2)C(t) ra 


where C(f) is the total capacitance of the fixed capacitor and the variable- 
voltage capacitor, and L, and L, are the two inductances in the frequency- 
determining network. Assume that for a modulating wave m(t) the ca- 
pacitance C(t) is expressed as follows 


C(t) = Co — k.m(t) (7.138) 


where C is the total capacitance in the absence of modulation, and k, is 
the variable capacitor’s sensitivity to voltage change. Substituting Eq. 7.138 
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C(t) 
Figure 7.44 
Hartley oscillator. 
in 7.137, we get 
i% -1/2 
AO = f1- E moo | (7.139) 
0 


where f is the unmodulated frequency of oscillation: 


1 


ee 7.140 

i 2n V C(L; F i>) ( ) 
Provided that the maximum change in capacitance produced by the mod- 
ulating wave is small compared with the unmodulated capacitance Cy, we 
may approximate Eq. 7.139 as follows 


Se 
fit) = fo |: + 2C, mo | (7.141) 
Define 
X foke 
k; = 2C, (7.142) 


We then obtain the following relation for the instantaneous frequency of 
the oscillator: 


filt) ~= fo + ksm(t) (7.143) 


where k, is the resultant frequency sensitivity of the modulator, defined 
by Eq. 7.142. 

An FM transmitter using the direct method as described herein, how- 
ever, has the disadvantage that the carrier frequency is not obtained from 
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Figure 7.45 f 
A feedback scheme for the frequency stabilization of a frequency modulator. 


a highly stable oscillator. It is therefore necessary, in practice, to provide 
some auxiliary means by which a very stable frequency generated by a 
crystal will be able to control the carrier frequency. One method of effecting 
this control is illustrated in Fig. 7.45. The output of the FM generator is 
applied to a mixer together with the output of a crystal-controlled oscillator, 
and the difference frequency term is extracted. The mixer output is next 
applied to a frequency discriminator and then low-pass filtered. A fre- 
quency discriminator is a device whose output voltage has an instantaneous 
amplitude that is proportional to the instantaneous frequency of the FM 
wave applied to its input; this device is described later in the section. When 
the FM transmitter has exactly the correct carrier frequency, the low-pass 
filter output is zero. However, deviations of the transmitter carrier fre- 
quency from its assigned value will cause the frequency discriminator-filter 
combination to develop a dc output voltage with a polarity determined by 
the sense of the transmitter frequency drift. This dc voltage, after suitable 
amplification, is applied to the voltage-controlled oscillator of the FM 
transmitter in such a way as to modify the frequency of the oscillator in a 
direction that tends to restore the carrier frequency to its required value. 


DEMODULATION OF FM WAVES 


The process of frequency demodulation is the inverse of frequency mod- 
ulation in the sense that it enables the original modulating wave to be 
recovered from a frequency-modulated wave. In particular, to perform 
frequency demodulation we require a two-port device that produces an 
output signal with amplitude directly proportional to the instantaneous fre- 
quency of a frequency-modulated wave used as the input signal. We refer 
to such a device as a frequency demodulator. 

There are various methods of designing a frequency demodulator. They 
can be categorized into two broadly defined classes: (1) direct and (2) 
indirect. The direct methods distinguish themselves by the fact that their 
development is inspired by a direct application of the definition of instan- 
taneous frequency. This class of frequency demodulators includes, as ex- 


FREQUENCY MODULATION 347 


amples, frequency-discriminators and zero crossing detectors. On the other 
hand, indirect methods of frequency demodulation rely on the use of feed- 
back to track variations in the instantaneous frequency of the input signal. 
The phase-locked loop is an example of this second class. In the remainder 
of this section, we describe the balanced frequency discriminator and zero- 
cross detector. The phase-locked loop is described in Section 7.12. 


Balanced Frequency Discriminator To pave the way for the development 
of the balanced frequency discriminator, we begin by considering an ideal- 
ized form of the circuit. In this context, we introduce the notion of an 
ideal slope circuit that is characterized by a purely imaginary transfer func- 
tion, varying linearly with frequency inside a prescribed interval. Such a 
circuit includes the differentiator as a special case. To be specific, consider 
the transfer function depicted in Fig. 7.46a, which is defined by 


jana(s- f+ 2), f.-Z<fef.t3 


H =4. B B B 
P=) jana(p + g), - 4 - erstes 
0, elsewhere (7.144) 


where a is a constant. We wish to evaluate the response of this slope circuit, 
denoted by s,(t), for an input FM signal s(t) of carrier frequency f, and 
transmission bandwidth B. It is assumed that the spectrum of s(f) is es- 
sentially zero outside the frequency band f. — B/2 = |f| < fe + B/2. For 
evaluation of the response s,(t), it is convenient to use the procedure 
described in Section 3.5, which involves replacing the slope circuit with an 
equivalent low-pass filter and driving this filter with the complex envelope 
of the input FM wave s(t). 

Let H,(f) denote the complex transfer function of the slope. circuit 
defined by Fig. 7.46a. This complex transfer function is related to H,(f) 
by 


ba — J.) = Ee fo (7.145) 


Hence, using Eqs. 7.144 and 7.145, we get 


B 
F jonal + 5), B B 
H= 2 noa 
0, elsewhere (7.146) 


which is shown in Fig. 7.46b. 
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slope = —27%a 
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Figure 7.46 

(a) Frequency response of ideal slope circuit. (b) Frequency response of complex 
low-pass filter equivalent to the slope circuit response of part a. (c) Frequency 
response of ideal slope circuit complementary to that of part a. 


The incoming FM wave s(t) is defined by Eq. 7.97, which is reproduced 
here for convenience: 


s(t) = A, cos| rf + 2nk, i ‘ m(t) a (7.147) 
0 
The complex envelope of this FM wave is 


s(t) = A. exp] 72xk; [ m(t) a| (7.148) 
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Let 5,(t) denote the complex envelope of the response of the slope 
circuit defined by Fig. 7.46a. Then we may express the Fourier transform 
of §,(¢) as 


Sf) = ACF) SCF) 
janal + 3) SO): if See 
E 2 2 
0, elsewhere (7.149) 


where S(f) is the Fourier transform of §(t). Now, from Section 2.3 we 
recall that the multiplication of the Fourier transform of a signal by the 
factor j27f is equivalent to differentiating the signal in the time domain. 
We thus deduce from Eq. 7.149 that 


i) =a [28 + jaB s(o) | (7.150) 
Substituting Eq. 7.148 in 7.150, we get 
P à 2kş , t 
ŝi (t) = jnBaA,. |1 + B m(t) | exp| j2zk; | m(t) dt} (7.151) 
0 


The response of the slope circuit is therefore 


s,(t) = Re[§,(t) exp(j27f.t)] 


rBaA| 1 + 7H men) | cos(2zfa + 2nk, [ mo dt + z) 
0 


(7.152) 


The signal s,(t) is a hybrid-modulated wave in which both the amplitude 
and frequency of the carrier wave vary with the message signal m(t). 
However, provided that we choose 


= | 


= nt 


for all t, then we may use an envelope detector to recover the amplitude 
variations and thus, except for a bias term, obtain the original message 
signal. The resulting envelope detector output is therefore 


|§,(t)| = nBaA {i+ reed, A mi | (7.153) 
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The bias term 2BaA, in the right side of Eq. 7.153 is proportional to 
the slope a of the transfer function of the slope circuit. This suggests that 
the bias may be removed by subtracting from the envelope detector output 
|§,(¢)| the output of a second envelope detector preceded by the comple- 
mentary slope circuit with a transfer function H,(f) as described in Fig. 
7.46c. That is, the respective complex transfer functions of the two slope 
circuits are related by 


Af) = Ay(-f) (7.154) 


Let s,(t) denote the response of the complementary slope circuit produced 
by the incoming FM wave s(t). Then, following a procedure similar to that 
described herein, we find that the envelope of s(t) is 


|5.(t)| = nBaA, E — = mo | (7.155) 


where s(t) is the complex envelope of the signal s,(t). The difference 
between the two envelopes in Eqs. 7.153 and 7.155 is 


s(t) = |i Ol - || 
4nk;aA.m(t) (7.156) 


which is free from bias. 

We may thus model the ideal frequency discriminator as a pair of slope 
circuits with their complex transfer functions related by Eq. 7.154, followed 
by envelope detectors and a summer, as in Fig. 7.47. This scheme is called 
a balanced frequency discriminator or back-to-back frequency detector. 

The idealized scheme of Fig. 7.47 can be closely realized using the circuit 
shown in Fig. 7.48a. The upper and lower resonant filter sections of this 
circuit are tuned to frequencies above and below the unmodulated carrier 
frequency f., respectively. In Fig. 7.48b we have plotted the amplitude 
responses of these two tuned filters, together with their total response, 
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Figure 7.47 
Idealized model of balanced frequency discriminator. 
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Balanced frequency discriminator. (a) Circuit diagram. (b) Frequency response. 


assuming that both filters have a high-Q factor. The linearity of the useful 
portion of this total response, centered at f,, is determined by the sepa- 
ration of the two resonant frequencies. As illustrated in Fig. 7.485, a 
frequency separation of 3B gives satisfactory results, where 2B, is the 
3-dB bandwidth of either filter. However, there will be distortion in the 
output of this frequency discriminator due to the following factors: 


1. The spectrum of the input FM wave s(t) is not exactly zero for fre- 
quencies outside the range fe — B/2 < |f| < fe + B/2. 

2. The tuned filter outputs are not strictly band-limited, and so some dis- 
tortion is introduced by the low-pass RC filters following the diodes in 


the envelope detectors. 
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3. The tuned filter characteristics are not linear over the whole frequency 
band of the input FM wave s(t). 


Nevertheless, by proper design, it is possible to maintain the distortion 
produced by these factors within tolerable limits. 


Zero-crossing Detector ‘This detector exploits the property that the in- 
stantaneous frequency of an FM wave is approximately given by 


= iba 
fis (7.157) 


where 4t is the time difference between adjacent zero crossings of the FM 
wave, as illustrated in Fig. 7.49. Consider an interval T chosen in accord- 
ance with the following two conditions: 


1. The interval T is small compared to the reciprocal of the message band- 
width W. 

2. The interval T is large compared to the reciprocal of the carrier frequency 
f: of the FM wave. 


Condition 1 means that the message signal m(t) is essentially constant 
inside the interval T. Condition 2 ensures that a reasonable number of zero 
crossings of the FM wave occurs inside the interval T. The FM waveform 
shown in Fig. 7.49 illustrates these two conditions. Let no denote the num- 
ber of zero crossings inside the interval T. We may then express the time 
At between adjacent zero crossings as 


if 
At = — (7.158) 
No 


=F} (4=At 
<q _ 7 —__»> 


Figure 7.49 
Illustrating Eq. 7.158. 
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Figure 7.50 
Block diagram of zero-crossing detector. 


Hence, we may rewrite Eq. 7.157 as 


No 


IOT 


(7.159) 


Since, by definition, the instantaneous frequency is linearly related to the 
message signal m(t), we see from Eq. 7.159 that m(t) can be recovered 
from a knowledge of no. Figure 7.50 is the block diagram of a simplified 
form of the zero-crossing detector based on this principle. The limiter 
produces a square-wave version of the input FM wave; the limiting of FM 
waves is discussed later in Section 7.13. The pulse generator produces short 
pulses at the positive-going as well as negative-going edges of the limiter 
output. Finally, the integrator performs the averaging over the interval T 
as indicated in Eq. 7.159, thereby reproducing the original message signal 
m(t) at its output. 


- EXERCISE 24 “Consider an FM wave s(t) that uses a linear modulating | 


eeevoceoccecorocones 


wave m(t) = at, where a is a constant. Show that the time difference 
between adjacent zero crossings of s(t) varies inversely with time. 


7.12 PHASE-LOCKED LOOP 


The phased-locked loop (PLL) is a negative feedback system that consists 
of three major components: a multiplier, a loop filter, and a voltage- 
controlled oscillator (VCO) connected together in the form of a feedback 
loop, as in Fig. 7.51. The VCO is a sine-wave generator whose frequency 
is determined by a voltage applied to it from an external source. In effect, 
any frequency modulator may serve as a VCO. 

We assume that initially we have adjusted the VCO so that when the 
control voltage is zero, two conditions are satisfied: (1) the frequency of 
the VCO is precisely set at the unmodulated carrier frequency f., and (2) 
the VCO output has a 90° phase-shift with respect to the unmodulated 
carrier wave. Suppose that the input signal applied to the phase-locked 
loop is an FM wave defined by 


s(t) = A, sin[2xf.t + $:(0)] (7.160) 
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Figure 7.51 
Phase-locked loop. 


where A, is the carrier amplitude. With a modulating wave m(t), we have 


PI = Ink, [mo dt (7.161) 


where k; is the frequency sensitivity of the frequency modulator. Let the 
VCO output be defined by 


r(t) = A, cos[2zf.t + ,(t)] (7.162) 


where A, is the amplitude. With a control voltage v(t) applied to the VCO 
input, we have 


eG paola | “on (7.163) 


where k, is the frequency sensitivity of the VCO, measured in hertz per 
volt. The incoming FM wave s(t) and the VCO output r(t) are applied to 
the multiplier, producing two components: 


1. A high-frequency component represented by 
knAcA, sinf4rfit + i(t) + $2(t)] 

2. A low-frequency component represented by k,, A.A, sin[,(t) — o2(t), 

where km is the multiplier gain, measured in volt ~! 


The high-frequency component is eliminated by the low-pass action of the 
filter and the VCO. Therefore, discarding the high-frequency component, 
the input to the loop filter is given by 


e(t) = k, A-A, sin[@,(t)] (7.164) 


PHASE-LOCKED LOOP 355 


where ¢,(t) is the phase error defined by 


pelt) = b(t) — 2(t) 
i) oe | u(t) dt (7.165) 


The loop filter operates on its input e(t) to produce the output 


v(t) = a a jar (7.166) 


where h(t) is the impulse response of the filter. 
Using Eqs. 7.164 through 7.166 to relate $,(t) and ġ,(t), and differ- 
entiating with respect to time, we obtain 


i 2- i 2 = ak, ie sin{@()|a(t — 2) de (7.167) 


where K, is a Joop parameter defined by 
Ky = kmk, AA, (7.168) 


Equation 7.167 suggests the representation or model of Fig. 7.52a. In this 
model we have also included the relationship between v(t) and e(t) as 
represented by Eqs. 7.164 and 7.166. We see that the block diagram of 
the model resembles Fig. 7.51. The multiplier is replaced by a subtractor 
and a sinusoidal nonlinearity, and the VCO by an integrator. 

The loop parameter Ky plays an important role in the operation of a 
phase-locked loop. It has the dimensions of frequency; this follows from 
Eq. 7.167, where we observe that the amplitudes A, and A,, are both 
measured in volts and the multiplier gain k,, is measured in volt7!. 


LINEARIZED MODEL 


When the phase error ¢,(t) is zero, the phase-locked loop is said to be in 
phase-lock. When @,(t) is at all times small compared with one radian, we 
may use the approximation 


sin[.(t)] = $.() (7.169) 


which is accurate to within 4% for @,(t) less than 0.5 rad. In this case the 
loop is said to be near phase-lock and the sinusoidal nonlinearity of Fig. 
7.52a may be disregarded. Thus we may represent the phase-locked loop 
by the linearized model shown in Fig. 7.526. According to this model, the 
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Figure 7.52 
(a) Nonlinear model of a phase-locked loop. (b) Linearized model. (c) Simplified 
model when the loop gain is very large compared to unity. 


phase error ¢,(t) is related to the input phase ¢,(t) by the integro-differ- 


ential equation: 


a one i CGE Sree an (7.170) 


Transforming Eq. 7.170 into the frequency domain and solving for ®.(f), 
the Fourier transform of ¢,(t), in terms of (f), the Fourier transform 


of ¢,(t), we get 


EO) = ES ®,(f) (7.171) 
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The function L(f) in Eq. 7.171 is defined by 


H(f) 
jf 
where H(f) is the transfer function of the loop filter. The quantity L(f) 
is called the open-loop transfer function of the phase-locked loop. Suppose 
that for all values of f inside the baseband we make the magnitude of L(f) 
very large compared with unity. Then from Eq. 7.171 we find that ©,(f) 
approaches zero. That is, the phase of the VCO becomes asymptotically 
equal to the phase of the incoming wave, and phase-lock is thereby estab- 

lished. 
From Fig. 7.52b we see that V(f), the Fourier transform of the phase- 
locked loop output v(t), is related to ®,(f) by 


L(f) = Ky (7.172) 


VG) = PAOLA) (7.173) 


or, equivalently, 


y= Aa (f) (7.174) 


Therefore, substituting Eq. 7.171 in 7.174, we may write 


Gf/kK)L(f) 


sO ae arr L(f) 


(f) (7.175) 


Again, when we make |L(f)| > 1, we may approximate Eq. 7.175 as 


- 


Aone — Af) (7.176) 


The corresponding time-domain relation is 


m dọ(t) 


O <a (7.177) 


Thus, provided the magnitude of L(f) is very large for all frequencies of 
interest, the phase-locked loop may be modeled as a differentiator with its 
output scaled by the factor 1/27k,, as in Fig. 7.52c. 

The simplified model of Fig. 7.52c provides the basis of using the phase- 
locked loop as a frequency demodulator. When the input signal is an FM 
wave as in Eq. 7.160, the phase ¢,(t) is related to the modulating wave 
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m(t) as in Eq. 7.161. Therefore, substituting Eq. 7.161 in 7.177, we find 
that the resulting output signal of the phase-locked loop is 


v(t) = £ m(t) (7.178) 


That is, the output v(t) of the phase-locked loop is approximately the same, 
except for the scale factor k,;/k,, as the original message signal m(t), and 
the frequency demodulation is accomplished. 

A significant feature of the phase-locked loop demodulator is that the 
bandwidth of the incoming FM wave can be much wider than that of the 
loop filter characterized by H(f). The transfer function H(f) can and 
should be restricted to the baseband. Then the control signal of the VCO 
has the bandwidth of the message signal m(t), whereas the VCO output 
is a wideband frequency modulated wave whose instantaneous frequency 
tracks that of the incoming FM wave. 

The complexity of the phase-locked loop is determined by the transfer 
function H(f) of the loop filter. The simplest form of a phase-locked loop 
is obtained when H(f) = 1; that is, there is no loop filter, and the resulting 
phase-locked loop is referred to as a first-order phase-locked loop (PLL). 
For higher-order loops, the transfer function H(f) assumes a more complex 
form. The order of the PLL is determined by the order of the denominator 
polynomial of the closed-loop transfer function, which defines the output 
transform V(f) in terms of the input transform ©,(f), as shown in Eq. 
7.175. In the next sub-section we study the properties of a first-order phase- 
locked loop demodulator using the linear model of Fig. 7.52a.}° 


FIRST-ORDER PHASE-LOCKED LOOP 


If the PLL has no loop filter, H(f) = 1, the linearized model of the loop 
simplifies as in Fig. 7.53, and Eq. 7.171 becomes 


Of) = ROW (7.179) 


We wish to investigate the loop behavior in the presence of a frequency- 
modulated input. In particular, we assume a single-tone modulating wave 


m(t) = Am cos(27f,,t) (7.180) 


When a phase-locked loop is used to demodulate an FM wave, the loop must first 
lock onto the incoming FM wave and then follow the variations in its phase. During 
the lock-up operation, the phase error ¢,(t) between the incoming FM wave and the 
VCO output will be large, which therefore requires the use of the nonlinear model of 
Fig. 7.522. 
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Figure 7.53 
Linearized model of first-order phase-locked loop. 


with the corresponding FM wave given by 
s(t) = A, sin[2zf,t + p sin(2z7f,,t)] (7.181) 
where f is the modulation index. Thus, 
pt) = p sinQzf,,t) (7.182) 


Therefore, using Eq. 7.182, we find that the phase error ¢,(t) of the loop 
produced by the phase input ¢,(t) of Eq. 7.179 varies sinusoidally with 
time, as shown by 


Pelt) = Peo COS(27f,zt + y) (7.183) 
The amplitude ¢,) and phase w of the phase error @¢,(t) are defined by 


AflKo 


[i + (fal KT” ce 


Peo = 


and 
y = —tan'(f,,/Ko) (7.185) 


where Af is the frequency deviation; that is, Af = Bf. 

In Fig. 7.54 we have plotted the phase-error amplitude ġo, normalized 
with respect to 4f/Ky, versus the dimensionless parameter f,,/Ky. It is 
apparent that for a fixed frequency deviation 4 f , the phase-error amplitude 
has its largest value of 4f/K, at fm = 0, and it decreases with increasing 
modulation frequency fm. 

For the loop to track the frequency modulation sufficiently closely, the 
phase error ¢,(t) should remain within the linear region of operation of 
the loop for all t. This means that the largest phase-error amplitude should 
not exceed 0.5 rad, so that e(t) satisfies the requirement of Eq. 7.169 for 
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Figure 7.54 
Phase-error amplitude characteristic of first-order phase-locked loop. 


all ¢. That is, the frequency deviation of the incoming FM wave s(t) should 
be bounded by 


Af < 0.5K, 


The output signal v(t) of the PLL is related to the phase error ¢,(t) by 
(see Fig. 7.53) 


v(t) = 2 eli) (7.186) 


Therefore, substituting Eq. 7.183 in 7.186, we get 
v(t) = Ay cos(2zfpt + y) 
where the amplitude A, is defined by 


Aflk, 


Ao T+ GAR 


(7.187) 


and the phase y is given by Eq. 7.185. From Eq. 7.186 we see that at a 
modulation frequency fm = Ko, the amplitude of the loop output u(t) will 
have fallen by 3 dB below its value at f,, = 0. The loop bandwidth of a 
first-order PLL is therefore Kọ. We also see from Eq. 7.187 that a first- 
order PLL demodulator introduces distortion between the original mod- 
ulating wave m(t) and the signal u(t) obtained at the PLL output. This 
distortion is the same as the frequency distortion produced by passing the 
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modulating wave m(t) through a low-pass RC filter of time constant 
1/272Ko. 

We have thus far assumed that the phase error is sufficiently small to 
allow the loop to be considered linear in its operation. We next wish to 
evaluate the input frequency range over which the PLL will hold lock. 
Assume a constant input frequency, for which 

dd,(t) 
= 2nof 


With this input applied to a first-order phase-locked loop, Eq. 7.167 be- 
comes 


ae J 2nK, a (t)] = = 2nof (7.188) 


The phase error ¢,(t) will have reached its steady-state value when the 
derivative d@,/dt is zero. Therefore, putting d¢,/dt = 0 in Eq. 7.188 we 
obtain 


sing, = at (7.189) 


0 


The sine of an angle cannot exceed unity in magnitude. Hence, Eq. 7.189 
has no solution for df > Kg. Instead, the loop falls out of lock and the 
phase error becomes a beat-note rather than a dc level. The hold-in fre- 
quency range of a first-order PLL is therefore equal to + Ko. In other words, 
a first-order PLL will lock to any constant input frequency, provided that 
it lies within the range + Ky of the VCO’s free-running frequency fe. 
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PRACTICAL CONSIDERATIONS 


From the foregoing analysis of a first-order PLL, we conclude that the loop 
parameter Ky, defined by Eq. 7.168, uniquely determines the loop band- 
width as well as the hold-in frequency range of the PLL. This is a major 
limitation of first-order PLLs. In order to track variations in the instan- 
taneous frequency of an FM wave, namely, 


fi(t) = fe + ksm(t) 


the loop parameter Ko must be large compared to the frequency deviation 
[i.e., the maximum departure of the instantaneous frequency f;(t) from 
the carrier frequency f,]. In the case of a first-order PLL, such a choice 
for Ko also results in a large loop bandwidth. This is undesirable because 
a large loop bandwidth lets in more noise power at the demodulator output 
than would normally be desired. Accordingly, we find that in practice a 
phase-locked loop used for frequency demodulation includes a loop filter. 

Figure 7.55 shows a filter!! often used in a second-order PLL. The filter 
consists of an integrator and a direct connection; its transfer function is 
given by 


fo 
jf 


where fo is a constant. The inclusion of such a filter in the loop provides 
the designer with an additional degree of freedom, namely, fọ. It is now 
possible to exercise control over both the loop parameter K, and the loop 
bandwidth." A second-order PLL is therefore capable of providing a good 
performance, and its use is adequate for most practical applications. 


A(f) =1+ 


2mfoR 


Input 
signal 


Operational 
amplifier 


Figure 7.55 
Loop filter for second-order phase-locked loop. 


"In the theory of feedback systems, the filter of Fig. 7.55 is referred to as a lead-lag 
filter. 
"For a detailed analysis of second-order phase-locked loops, see Gardner (1979). 
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When an FM wave is transmitted through a communication channel, in 
general, the output will not have a constant amplitude because of channel 
imperfections. At the receiver, it is essential to remove the amplitude 
fluctuations in the channel output prior to frequency demodulation. This 
is customarily done by means of an amplitude limiter. Figure 7.56 shows 
the input-output characteristic of an idealized form of amplitude limiter 
known as a hard limiter. The resulting output is essentially an FM square 
wave. 

To analyze the FM output of a hard limiter, we assume that the limiter 
is in the form of a memoryless device. Accordingly, we may express the 
limiter output, in response to a frequency-modulated input z(t), as 


v(t) 


sgn[z(t)] 


oL if A = 0 
5 ik 0 CD 
We also assume that the amplitude fluctuations are slow compared to the 
zero-crossing rate of the frequency-modulated input z(t). We may then 
take the sign changes of z(t) as being proportional to the carrier phase 
shifts, as shown by 


v(t) = sgn{cos[O(t)]} (7.191) 


where @(f) is the angular argument of the FM wave. The function sgn{cos[9]}, 
viewed as a function of 0, is a periodic square wave when the modulation 
is zero. Hence, using the Fourier series representation of sgn{cos[@]}, we 
may write 


sgn{cos[O]} = —— >> (- ) oe (7.192) 


Output 


Input 


Figure 7.56 ran 
Input-output characateristic of a hard limiter. 
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This expansion holds for all 6. Thus, using 6(t) in place of 8 in Eq. 7.192, 
we may express the hard limiter output as 


45 q- rpi LOE = lant + O60) 


ey eae (7.193) 


where f. is the carrier frequency, and the phase 0(t) is related to the 
message signal of interest. 

Equation 7.193 shows that the hard limiting operation produces image 
FM sidebands at odd harmonics of the carrier frequency f.. When the 
carrier frequency f. is sufficiently large, we may use a band-pass filter 
(centered on f.) to select the desired FM wave: 


v(t) = $ cosl2n fit + 6(t)] 


In practice, the combination of hard limiter and band-pass filter is imple- 
mented as a single circuit commonly referred to as a band-pass limiter. 


SDSS: 7.14 APPLICATION li: FM RADIO 


In Section 7.9 we described the standard AM radio format for audio signals 
and the television for video signals. In this section, we describe FM radio” 
that pertains to the remaining type of radio broadcasting. 

As with standard AM radio, most FM radio receivers are of the super- 
hetrodyne type. The block diagram of such an FM receiver is shown in Fig. 
7.57. The RF section and the local oscillator are mechanically coupled to 
provide for a common tuning. A frequency-modulated wave with a fixed 
carrier frequency is thereby produced at the output of the IF section. 

Typical frequency parameters of commercial FM radio are 


RF carrier range = 88-108 MHz 
Midband frequency of IF section = 10.7 MHz 
IF bandwidth = 200 kHz 


For some historical notes on frequency modulation and its use in radio 
broadcasting, see Lathi (1983, pp. 301-302). 
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In an FM radio, the message information is transmitted by variations 
of the instantaneous frequency of a sinusoidal carrier wave, and its am- 
plitude is maintained constant. Therefore, any variations of the carrier 
amplitude at the receiver input must result from noise or interference. The 
amplitude limiter, following the IF section in Fig. 7.57 is used to remove 
amplitude variations by hard-limiting the modulated wave at the IF section 
output. The resulting rectangular wave is rounded off by a band-pass filter 
that suppresses harmonics of the carrier frequency. Thus the filter output 
is again sinusoidal, with an amplitude that is practically independent of the 
carrier amplitude at the receiver input. The amplitude limiter and filter 
usually form an integral unit. : 

The discriminator performs the required frequency demodulation. If 
there were no noise at the receiver input, the message signal would be 
recovered with no contamination at the discriminator output. However, 
the inevitable presence of receiver noise precludes the possibility of such 
an occurrence. To minimize the degrading effects of noise, two modifica- 
tions are therefore made in the receiver: 


1. A de-emphasis network is added to the audio power amplifier so as to 
compensate for the use of a pre-emphasis network at the transmitter. 
The reason for employing pre-emphasis is to shape the spectrum of the 
message signal at the discriminator output so that it more approximately 
matches the corresponding noise spectrum. 

2. A post-detection filter, labeled “baseband low-pass filter,” is added at 
the output end of the receiver. This filter has a bandwidth that is just 
large enough to accommodate the highest frequency component of the 
message signal. Hence, by including it, the out-of-band components of 
noise at the discriminator output are suppressed. 


Both these issues are explained in full in Chapter 9. 


FM STEREO MULTIPLEXING 


Stereo multiplexing is a form of frequency-division multiplexing (FDM) 
designed to transmit two separate signals via the same carrier. It is widely 
used in FM broadcasting to send two different elements of a program (e.g., 
two different sections of an orchestra, a vocalist and an accompanist) so 
as to give a spatial dimension to its perception by a listener at the receiving 
end. 

The specification of standards for FM stereo transmission is influenced 
by two factors: 


1. The transmission has to operate within the allocated FM broadcast 
channels. 


2. It has to be compatible with monophonic receivers. 
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The first requirement sets the permissible frequency parameters, including 
frequency deviation. The second requirement constrains the way in which 
the transmitted signal is configured. 

Figure 7.58a shows the block diagram of the multiplexing system used 
in an FM stereo transmitter. Let m,(t) and m,(t) denote the signals picked 
up by left-hand and right-hand microphones at the transmitting end of the 
system. They are applied to a simple matrixer that generates the sum signal, 
m(t) + m,(t), and the difference signal, m(t) — m,(t). The sum signal is 
left unprocessed in its baseband form; it is available for monophonic re- 
ception. The difference signal and a 38-kHz subcarrier (derived from a 19- 
kHz crystal oscillator by frequency doubling) are applied to a product 


m(t) + 
O 
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doubler 
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BPF 
centered at 
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Figure 7.58 : 
(a) Multiplexer in transmitter of FM stereo. (b) Demultiplexer in receiver of FM 


stereo. 


eeeeesnceseecoese 


368 MODULATION TECHNIQUES 


modulator, thereby producing a DSBSC modulated wave. In addition to 
the sum signal and this DSBSC modulated wave, the multiplexed signal 
m(t) also includes a 19-kHz pilot to provide a reference for the coherent 
detection of the difference signal at the stereo receiver. Thus the multi- 
plexed signal is described by 


m(t) = [m,(t) + m,(t)] + [m(t) — m,(t)] cos(4z f.t) + K cos(2zf.t) 
(7.194) 


where f. = 19 kHz. The multiplexed signal m(t) then frequency modulates 
the main carrier to produce the transmitted signal. The pilot is allotted 
between 8 and 10% of the peak frequency deviation; the amplitude K in 
Eq. 7.194 is chosen to satisfy this requirement. 

At a stereo receiver, the multiplexed signal m(t) is recovered from the 
incoming FM wave. Then m(t) is applied to the demultiplexing system 
shown in Fig. 7.58b. The individual components of the multiplexed signal 
m(t) are separated by the use of three appropriate filters. The recovered 
pilot is frequency-doubled to produce the desired 38 kHz subcarrier. The 
availability of this subcarrier enables the coherent detection of the DSBSC 
modulated wave, thereby recovering the difference signal, m,(t) — m,(t). 
The baseband low-pass filter in the top path of Fig. 7.58b is designed to 
pass the sum signal, m,(t) + m,(t). Finally, the simple matrixer recon- 
structs the left-hand signal, m,(¢), and right-hand signal, m,(t), and applies 
them to their respective speakers. 


7.15 DIGITAL MODULATION TECHNIQUES 


In this section we shift the focus of our attention from analog signals to 
digital signals as the modulating wave. In particular, we describe digital 
modulation techniques that may be used to transmit binary data over a 
band-pass communication channel with fixed frequency limits set by the 
channel. The notions involved in the generation of digital-modulated waves 
are basically the same as those described for analog-modulated waves. The 
differences that do exist between them are manifestations of the intrinsic 
differences between digital signals and analog signals as the source of mod- 
ulation. 


BINARY MODULATION TECHNIQUES 


With a binary modulation technique, the modulation process corresponds 
to switching or keying the amplitude, frequency, or phase of the carrier 
between either of two possible values corresponding to binary symbols 0 
and 1. This results in three basic signaling techniques, namely, amplitude- 
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shift keying (ASK), frequency-shift keying (FSK), and phase-shift keying 
(PSK), as described herein: 


1: 


In an ASK system, binary symbol 1 is represented by transmitting a 
sinusoidal carrier wave of fixed amplitude A, and fixed frequency f, for 
the bit duration T, seconds, whereas binary symbol 0 is represented by 
switching off the carrier for T, seconds, as illustrated in Fig. 7.59a. In 
mathematical terms, we may express the binary ASK wave s(t) as: 


_ | Ap cos(27zf.t), symbol 1 
s(t) = a svaiboto (7.195) 


. In a PSK system, a sinusoidal carrier wave of fixed amplitude A, and 


fixed frequency f, is used to represent both symbols 1 and 0, except 
that the carrier phase for each symbol differs by 180°, as illustrated in 
Fig. 7.59b. In this case, we may express the binary PSK as: 


_ JA, cos(27f.t), symbol 1 
= E cos(27z f.t + 7), symbol 0 >) 


. In an FSK system, two sinusoidal waves of the same amplitude A, but 


different frequencies fı and f, are used to represent binary symbols 1 


Binary 
data 0 il 1 0 1 0 0 1 


(c) 


Figure 7.59 : : r 
The three basic forms of signaling binary information. (a) Amplitude-shift keying. 
(b) Phase-shift keying. (c) Frequency-shift keying with continuous phase. 
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and 0, respectively, as in Fig. 7.59c. That is, we may express the binary 
FSK wave s(t) as: 


_ JA, cos(2zf,t), symbol 1 
A D cos(2zft), symbol 0 CE 


It is apparent, therefore, that ASK, PSK, and FSK signals are special cases 
of amplitude-modulated, phase-modulated, and frequency-modulated 
waves, respectively. 


"EXERCISE 27 Show that the binary FSK waveform of Fig. 7.59c may be 
viewed as the superposition of two binary ASK waveforms. 


GENERATION AND DETECTION OF BINARY MODULATED WAVES 


To generate an ASK wave, we may simply apply the incoming binary data 
(represented in unipolar form) and the sinusoidal carrier to a product 
modulator, as in Fig. 7.60a. The resulting output provides the desired ASK 
wave. 

To generate a PSK wave, we may use the same scheme, except that the 
incoming binary data are represented in polar form, as in Fig. 7.60b. From 
this arrangement, we deduce that a binary PSK wave may also be viewed 
as a double-sideband suppressed-carrier modulated wave. This remark also 
applies to a binary ASK wave. 

To generate an FSK wave, we may apply the incoming binary data 
(represented in polar form) to a frequency modulator, as in Fig. 7.60c. As 
the modulator input changes from one voltage level to another (both non- 
zero), the transmitted frequency changes in a corresponding fashion. 

For the demodulation of a binary ASK or PSK wave, we may use a 
coherent detector depicted as in Fig. 7.61a. The detector consists of three 
basic components: 


1. A multiplier (i.e., product modulator), supplied with a locally generated 
version of the sinusoidal carrier. 

2. An integrator that operates on the multiplier output for successive bit 
intervals; this integrator performs a low-pass filtering action (see Prob- 
lem 13 of Chapter 3). 

3. A decision device that compares the integrator output with a preset 
threshold; it makes a decision in favor of symbol 1 if the threshold is 
exceeded, and in favor of symbol 0 otherwise. 


The basic difference between the demodulation of a binary ASK wave and 
that of a binary PSK wave lies in the choice of the threshold level. 

For the demodulation of a binary FSK wave, we may use a coherent 
detector as shown in Fig. 7.61b. This dectector consists of two correlators 
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Binary wave 
in Product Binary ASK wave 
unipolar form modulator s(t) 
m(t) 
Carrier wave 
A, cos(2rf, t) 
(a) 
Binary wave 
in Product Binary PSK wave 
polar form modulator s(t) 
m(t) 
Carrier wave 
A, cos(2mf,t) 
(b) 
Binary wave 
in Frequency Binary FSK wave 
„polar form modulator s(t) 
m(t) 


Carrier wave 
A, cos(27f, t) 


(c) 


Figure 7.60 
Generation schemes for (a) binary ASK, (b) binary PSK, and (c) binary FSK. 


Binary ASK wave 
or 


Binary PSK wave Say 0, otherwise 


: Say 1, if, >l 
Binary hee 
FSK wave < Say 0, otherwise 

l 
cos(2 rf t) (b) 
Figure 7.61 


Coherent detectors for (a) binary ASK or binary PSK, and (b) binary FSK. 
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Say 1, if threshold is exceeded 
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that are individually tuned to the two different carrier frequencies chosen 
to represent symbols 1 and 0. The decision device compares the two cor- 
relator outputs. If the output /, produced in the upper path (associated 
with frequency f) is greater than the output l, produced in the lower path 
(associated with frequency f,), the detector makes a decision in favor of 
symbol 1; otherwise, it decides in favor of symbol 0. 

The detectors (receivers) described in Fig. 7.61a and b are both coherent 
in the sense that they require two forms of synchronization for their op- 
eration: 


1. Phase synchronization, which ensures that the ‘carrier wave generated 
locally in the receiver is locked in phase with respect to that employed 
in the modulator (transmitter). 

2. Timing synchronization, which ensures proper timing of the decision- 
making operation in the receiver with respect to the switching instants 
(i.e., switching between symbols 1 and 0) in the original binary data 
stream applied to the modulator input. 


For certain digital modulation formats, the receiver design may be sim- 
plified by ignoring phase synchronization. Specifically, binary ASK waves 
may be demodulated noncoherently using an envelope detector. Likewise, 
binary FSK waves may be demodulated noncoherently by applying the 
received signal to a bank of two filters, one tuned to frequency f, and the 
other tuned to frequency fz. Each filter is followed by an envelope detector. 
The resulting outputs of the two envelope detectors are sampled and then 
compared to each other. A decision is made in favor of symbol 1 if the 
envelope-detected output derived from the filter tuned to frequency f, is 
larger than that derived from the second filter. Otherwise, a decision is 
made in favor of symbol 0. 

As for PSK, it cannot be detected noncoherently because the envelope 
of a PSK wave is the same for both symbols 1 and 0 and a single carrier 
frequency is used for the modulation process. To eliminate the need for 
phase synchronization of the receiver with PSK, we may incorporate dif- 
ferential encoding. In differential encoding, we encode the digital infor- 
mation content of a binary data in terms of signal transitions. For example, 
we may use symbol 0 to represent transition in a given binary sequence 
(with respect to the previous encoded bit) and symbol 1 to represent no 
transition. A signaling technique that combines differential encoding with 
phase-shift keying is known as differential phase-shift keying (DPSK). Fig- 
ure 7.62 illustrates the two steps involved in the generation of a DPSK 
signal, assuming the input binary data 10010011. Note that the differential 
encoded sequence (and therefore the DPSK signal) has an extra initial bit. 
In Fig. 7.62, the initial bit is assumed to be a 1. For the differentially 
coherent detection of a DPSK signal, we may use the receiver shown in 
Fig. 7.63. At any particular instant of time, we have the received DPSK 
signal as one input into the multiplier in Fig. 7.63 and a delayed version 
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Binary 
data 1 (0) (0) 1 0 0 1 1 
Differentially 
encoded =; 1 0 1 1 0 1 1 1 
binary 
data ; 
Initial 
bit 
Phase of 
DPSK signal O0 0 T 0 0 T 0 0 0 
(radians) 2 
Figure 7.62 


The relationship betrween a binary sequence and its differentially encoded and 
DPSK versions. 


of this signal, delayed by the bit duration T,, as the other input. The 
integrator output is proportional to cos@, where ¢ is the difference between 
the carrier phase angles in the received DPSK signal and its delayed version, 
measured in the same bit interval. Therefore, when ¢ = 0 (corresponding 
to symbol 1), the integrator output is positive; on the other hand, when 
$ = x (corresponding to symbol 0), the integrator output is negative. Thus, 
by comparing the integrator output with a decision level of zero volts, the 
receiver of Fig. 7.63 can reconstruct the binary sequence, which, in the 
absence of noise, is exactly the same as the original binary data at the 
transmitter input. 


DISCUSSION 


The detectors shown in Fig. 7.61 are based on the use of a correlator that 
consists of a multiplier followed by an integrator. Digital communication 
receivers designed in this way are called correlation receivers. The corre- 
lator may be replaced by the combination of a multiplier, low-pass filter, 
and sampler; except for the sampler, such a combination parallels the 
scheme used for the coherent detection of amplitude-modulated waves. 


Choose 1 
Decision fian 
DPSK signal device Otherwise, 
choose 0 


Threshold 
of zero volts 


Figure 7.63 l 
Receiver for the detection of DPSK signals. 
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However, in Chapter 10 it is shown that the correlation receiver is optimum 
for the detection of a pulse in a common type of channel noise called 
additive white Gaussian noise. Moreover, the combination of a multiplier 
and low-pass filter is suboptimum in comparison with the correlation re- 
ceiver; hence, the preference for the use of a correlator in the detectors 
of Fig. 7.61. 

The coherent detection of ASK, PSK, and FSK signals involves the use 
of linear operations and assumes the availability of local carriers (reference 
signals) that are in perfect synchronism with the carriers in the transmitter. 
On the other hand, the noncoherent detection of ASK and FSK signals 
involves nonlinear operations; the detection of DPSK signals involves the 
use of linear operations but the supply of a noisy reference signal. Ac- 
cordingly, we find that the mathematical analysis of noise in the class of 
noncoherent receivers is much more complicated than the class of coherent 
receivers; more will be said on this issue in Chapter 10. 

Another point that will emerge from the discussion presented in Chapter 
10 is that receiver design simplification resulting from the use of nonco- 
herent detection is achieved at the cost of some degradation in receiver 
performance in the presence of noise, compared to a coherent receiver. 

It is also noteworthy that none of the digital modulation techniques 
described thus far is spectrally efficient, meaning that the available channel 
bandwidth is not fully used. To provide for spectral efficiency we may use 
baseband signal shaping combined with a bandwidth-conserving linear 
modulation scheme such as vestigial sideband modulation; we studied base- 
band shaping in Chapter 6 and vestigial sideband modulation in Section 
7.5. In the next two sections we describe two other spectrally efficient 
modulation techniques known as quadriphase-shift keying and minimum 
shift keying, which are well suited for the transmission of digital data. 


QUADRIPHASE-SHIFT KEYING 


In binary data transmission, we send only one of two possible signals during 
each bit interval T,. On the other hand, in an M-ary data transmission 
system we send any one of M possible signals, during each signaling interval 
T. For almost all applications, the number of possible signals M = 2”, 
where n is an integer, and the signaling interval T = nT,. It is apparent 
that a binary data transmission system is a special case of an M-ary data 
transmission system. Each of the M signals is called a symbol. The rate at 
which these symbols are transmitted through the communication channel 
is expressed in units of bauds. A baud stands for one symbol per second; 
for M-ary data transmission, it equals log,M bits per second. 

In this subsection, we consider quadriphase-shift keying (QPSK), which 
is an example of M-ary data transmission with M = 4. In quadriphase- 
shift keying, one of four possible signals is transmitted during each signaling 
interval, with each signal uniquely related to a dibit (pairs of bits are termed 
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dibits). For example, we may represent the four possible dibits 00, 10, 11, 
and 01 (in Gray-encoded form) by transmitting a sinusoidal carrier with 
one of four possible values, as follows: 


A. cos( 2 - 2), dibit 00 


A. cos| 2rf.t — z), dibit 10 
s(t) = (7.198) 


A, cos( 2 + z), dibit 11 


A, cos| 2zf.t + 3), dibit 01 


where 0 < t < T; we refer to T as the symbol duration. Figure 7.64 de- 
picts the QPSK waveform (based on Eq. 7.198) for the binary sequence 
01101000. 

Clearly, QPSK represents a special form of phase modulation. This is 
done by expressing s(t) succinctly as 


s(t) = A, cos[2zf,t + $0] (7.199) 


where the phase ġ(t) assumes a constant value for each dibit of the in- 
coming data stream. Specifically, we have (see Fig. 7.65) 


3 

ae dibit 00 

=a dibit 10 

p(t) = i (7.200) 

=  dibit 11 

4 

= dibit 01 

Binary sequence 0 1 1 0 1 0 0 0) 


Figure 7.64 
OPSK wave for the binary sequence 01101000, assuming the coding arrangement of 


(Eo), 7198. 
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p(t) 
Dibit 00 
Dibit 10 
p(t) 
Dibit 11 T/4 
I 
0 t 
T 2T, 
p(t) 
37/4 
L] 
Dibit 01 i 
i 
[] 
0 i t 
Ty 27, 


Figure 7.65 
The coding of carrier phase of QPSK; the dibits are shown in Gray-coded form. 


We may develop further insight into the representation of QPSK by ex- 
panding the cosine term in Eq. 7.199 and rewriting the expression for s(t) 
as 


s(t) = A, cos[(t)] cos(2zf,t) — A, sin[ġ(t)] sin(2zf,t) (7.201) 


According to this representation, the QPSK wave s(t) has an in-phase 
component equal to A, cos[@(t)] and a quadrature component equal to 
A, sin[ġ(¢t)]. 

The representation of Eq. 7.201 provides the basis for the block diagram 
of the QPSK transmitter shown in Fig. 7.66a. It consists of a serial-to- 
parallel converter, a pair of product modulators, a supply of the two carrier 
waves in phase quadrature, and a summer. The function of the serial-to- 
parallel converter is to represent each successive pair of bits of the incoming 
binary data stream m(t) as two separate bits, with one bit applied to the 
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A..cos (27f, t) 


Oscillator 
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In-phase channel 


Decision 
device 


cos (27f, t) 


Oscillator 


Threshold 


Reconstructed 
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signal serial 
converter 


—90° 
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shifter Threshold 


sin (27f,t) 


Decision 
device 


Quadrature channel 
(b) 


Figure 7.66 ; 
Block diagrams of (a) QPSK transmitter, and (b) coherent QPSK receiver. 
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in-phase channel of the transmitter and the other bit applied to the quad- 
rature channel. It is apparent that the signaling interval T in a QPSK system 
is twice as long as the bit duration T, of the input binary data stream m(t). 
That is, for a given bit rate 1/T,, a QPSK system requires half the trans- 
mission bandwidth of the corresponding binary PSK system. Equivalently, 
for a given transmission bandwidth, a QPSK system carries twice as many 
bits of information as the corresponding binary PSK system. 

The QPSK receiver consists of two correlators connected in parallel as 
in Fig. 7.666. One correlator computes the cosine of the carrier phase, 
whereas the other correlator computes the sine of the carrier phase. By 
comparing the signs of the two correlator outputs through the use of a pair 
of decision devices, a unique resolution of one of the four transmitted 
phase angles is made. In particular, the parallel-to-serial converter inter- 
leaves the decisions made by the in-phase and quadrature channels of the 
receiver and thereby reconstructs a binary data stream which, in the ab- 
sence of receiver noise, is identical to the original one at the transmitter 
input. 

We may thus view a QPSK scheme as two binary PSK schemes that 
operate in parallel and employ two carrier waves that are in phase quad- 
rature. In other words, QPSK is a quadrature-carrier multiplexing scheme 
that offers bandwidth conservation, compared to binary PSK. 


MINIMUM SHIFT KEYING 


In the binary FSK wave shown in Fig. 7.59c, phase continuity is maintained 
at the transition points as the incoming binary data stream switches back 
and forth between symbols 1 and 0. Accordingly, such a modulated wave 
is referred to as a continuous-phase frequency-shift keying (CPFSK) wave. 
A special form of binary CPFSK known as minimum shift keying (MSK) 
arises when the change in carrier frequency from symbol 0 to symbol 1, or 
vice versa, is equal to one half the bit rate of the incoming data. To be 
specific, let df denote the frequency change so defined and T, denote the 
bit duration. We may then define MSK as that form of CPFSK that satisfies 
the condition: 


1 
oe aa (7.202) 


More specifically, let the frequencies f, and f represent the transmission 
of symbols 1 and 0, respectively. Clearly, frequency fı may be expressed 
as 


e a 


__ 


2 2 
= a (7.203) 
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where 
+ 
ee hth 5 fz (7.204) 
and 
Ol = fu = i (7.205) 
Similarly, we may express the second carrier frequency fa as 
i Seis aie, 
i 2 j 
ô 
= j= d (7.206) 


The “unmodulated” carrier frequency f, represents the arithmetic mean 
of the two transmitted frequencies f, and f, as in Eq. 7.204. 
Define the MSK signal as 


s(t) = A, cos[2zf,t + d(t)] 
where 
p(t) = +ndoft 
Hence, under the condition specified by Eq. 7.202, the transmission of 


symbol 1 (i.e., frequency f,) changes the phase of the MSK signal s(t) by 
an amount defined by 


noft 
nmt 


EA 


p(t) 
symbol 1 (7.207) 


From this relation we see that at the termination of the interval representing 
the transmission of symbol 1 at time t = T, the phase of an MSK wave 
increases by an amount equal to z/2 radians. On the other hand, the 
transmission of symbol 0 (i.e., frequency f,) changes the phase of the MSK 
wave s(t) by an amount defined by 


p(t) = —nxdft 
e me symbol 0 (7.208) 


This means that at the termination of the interval representing the trans- 
mission of symbol 0 at time tf = T, the phase of an MSK wave decreases 
by an amount equal to 7/2 radians. 
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We are now ready to demonstrate that MSK may be viewed as another 
example of quadrature multiplexing. First, we express the MSK wave s(t) 
as a frequency-modulated wave as follows: 


s(t) = A, cos[2zf,t + (t)] 
= A. cos(2zf,t) cos[d(t)] — A, sin(27 f.t) sin[@(t)] (7.209) 


This shows that s(t) has an in-phase component equal to A, cos[@(t)] and 
a quadrature component equal to A, sin[¢(t)]. As with QPSK, there are 
four distinct dibits to be considered; they are 00, 10, 11, and 01. Consider 
first the transmission of dibit 00. In this case, the phase of the MSK wave 


p(t) 


Dibit 00 


Dibit 10 


Dibit 11 


Dibit 01 


Figure 7.67 
Coding of the carrier phase $(t) for MSK; the dibits are shown in Gray-coded form. 
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TABLE 7.4 

Dibit 

(Gray coded) sin[ġ(T,)] cos[ġ(2T,)] 
00 —1 -1 
10> +1 +1 
iúl +1 =íl 
01 =i aIl 


experiencing a decrease (representing the first symbol 0) is followed by 
another decrease (representing the second symbol 0). Hence, the phase 
history of the MSK wave traces the path shown in Fig. 7.67a. Similarly, 
we find that the transmission of dibits 10, 11, and 01 traces the respective 
paths shown in parts b, c, and d of Fig. 7.67 for the phase history of the 
MSK wave. In Fig. 7.67 it is assumed that the initial condition is defined 
by ¢(0) = 0. Note that at time t = T, the phase of the MSK wave equals 
+7/2 or —x/2 radians, whereas at time t = 2T, it equals 0 or z radians, 
modulo 2z. 

In Table 7.4 we show the pair of values, sin[ġ(T,)] and cos[ġ(2T;)], 
corresponding to each of the four possible dibits. This table shows that the 
identity of each dibit in MSK is uniquely defined by specifying the doublet 
{sin[4(T;)], cos[@(27,)]}. 

We thus see that QPSK and MSK are examples of quadrature multi- 
plexing. They differ from each other in the sense that QPSK is a phase- 
modulated wave whereas MSK is a frequency-modulated wave. This basic 
difference manifests itself in the way in which the phase shift ¢(t) of the 
sinusoidal carrier varies with time. In QPSK, the phase shift (t) assumes 
a distinct value that is constant for the entire duration of a symbol, de- 
pending on the dibit being transmitted, as in Fig. 7.65. In MSK, on the 
other hand, for each dibit the phase shift ¢(t) varies with time along a 
distinct path made up of straight lines, depending on the dibit being trans- 
mitted, as in Fig. 7.67. 

To generate an MSK wave, we may use a frequency modulator that 
fulfills the condition of Eq. 7.202. The coherent detection of MSK, how- 
ever, involves a mathematical treatment that is beyond the scope of this 
introductory book. Nevertheless, it suffices to say that the coherent de- 
tector consists of a pair of correlators with built-in memory and decisions 
made over successive pairs of bit intervals. The detector is designed in such 
a way that it can track the past history of the phase ọ(¢) as it evolves in 
time on a bit-by-bit basis, and thereby reconstruct a binary wave that (in 
the absence of receiver noise) is the same as that at the transmitter input. 


“For a detailed treatment of minimum shift keying, see Haykin (1988, pp. 291-300). 
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-7.16 APPLICATION lii: DIGITAL COMMUNICATIONS BY SATELLITE 


In this section we briefly describe the application of digital modulation for 
the transmission of binary data over a satellite channel. The satellite channel 
consists of an uplink, a transponder, and a downlink, as in Fig. 7.68. The 
uplink connects a transmitting station on the ground to the transponder 
on board a satellite positioned in geostationary orbit around the earth. The 
downlink connects the transponder to a receiving ground station (usually 
placed at a remote distance away from the transmitting ground station). 
The transponder is designed to provide adequate amplification to overcome 
the effects of channel noise. We may therefore view the satellite tran- 
sponder as a repeater in the sky. 

A satellite channel has a built-in broadcast capability. To exploit it, 
however, we require the use of a technique known as multiple access. A 
particular type of this technique, known as time-division multiple access 
(TDMA), is well suited for digital communications. In TDMA, a number 
of ground stations are able to access a satellite by having their individual 
transmissions reach the satellite in nonoverlapping time slots. Hence, the 
radio frequency (RF) power amplifier at the output of the satellite tran- 
sponder may be permitted to operate at or near saturation without having 
to introduce crosstalk between individual transmissions. Such a feature, 
which is essentially unique to TDMA, helps to optimize the noise per- 
formance of the receiver. Moreover, since only one modulated carrier is 
present in the nonlinear transponder at any one time, the generation of 
intermodulation products is avoided. 


Satellite transponder 


A 


Downlink 
Uplink 


Transmitting station Receiving 
Station 


Figure 7.68 
Satellite link. 


“There are two other types of multiple access, namely, frequency-division multiple 
access (FDMA) and code-division multiple access (CDMA). The former is used for 
analog communications and the latter is used for secure communications. For 
discussions of the TDMA network, see Pratt and Bostian (1986, pp. 235-251). 
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Figure 7.69 
Structure of a TDMA frame. 


Figure 7.69 illustrates the idea of a TDMA network, in which trans- 
missions are organized into frames. A frame contains N bursts. To com- 
pensate for variations in satellite range, a guard time is inserted between 
successive bursts as in Fig. 7.69 to protect the system against overlap. One 
burst per frame is used as a reference. The remaining N — 1 bursts are 
allocated to ground stations on the basis of one burst per station. Thus, 
each station transmits once per frame. Typically, a burst consists of an 
initial portion called the preamble, which is followed by a message portion; 
in some systems a postamble is also included. The preamble consists of a 
part for carrier recovery, a part for symbol-timing recovery, a unique word 
for burst synchronization, a station identification code, and some house- 
keeping symbols. Two functionally different components may therefore be 
identified in each frame: a revenue-producing component represented by 
message portions of the bursts, and system overhead represented by guard 
times, the reference burst, preambles, and postambles (if included). 

Two important points emerge from this brief discussion of the TDMA 
network: 


1. Power efficiency in a satellite transponder is maximized by permitting 
the traveling-wave tube (responsible for power amplification) to operate 
at or near saturation. 

2. The transmissions contain independent provisions for carrier synchro- 
nization and bit timing synchronization to occur simultaneously, thereby 
keeping overhead due to recovery time in the receiver to a minimum. 


Therefore, only a limited set of digital modulation techniques is suitable 
for satellite communications. In particular, point 1 constrains the modu- 
lation format to have a constant envelope, thereby excluding ASK. Point 
2 makes it feasible to employ coherent detection. We therefore find that 
in digital communications by satellite, primary interest is in the use of 
coherent binary PSK, coherent QPSK, and coherent MSK. 
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PROBLEMS 


P7.1 Amplitude Modulation 


Problem 1 Consider the message signal 
m(t) = 20 cos(2zt) volts 
and the carrier wave 


c(t) = 50 cos(100zf) volts 


(a) Sketch (to scale) the resulting AM wave for 75% modulation. 
(b) Find the power developed across a load of 100 ohms due to this 
AM wave. 


Problem 2 A carrier wave of frequency 1 MHz is modulated 50% by a 
sinusoidal wave of frequency 5 kHz. The resulting AM wave is transmitted 
through the resonant circuit of Fig. P7.1, which is tuned to the carrier 
frequency and has a Q factor of 175. Determine the modulated wave after 
transmission through this circuit. What is the percentage modulation of 
this modulated wave? 


Problem 3 Using the message signal 


OS ear 


determine and sketch the modulated wave for amplitude modulation whose 
percentage modulation equals the following values: 


(a) 50% 
(b) 100% 
(c) 125% 


a 


+ 
Curran me C L Output signal 


ae 


Figure P7.1 
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Problem 4 For a p-n junction diode, the current i through the diode and 
the voltage v across it are related by 


afea) 


where J, is the reverse saturation current and V; is the thermal voltage 
defined by 


where k is Boltzmann’s constant in joules per degree Kelvin, T is the 
absolute temperature in degrees Kelvin, and e is the charge of an electron. 
At room temperature Vy = 0.026 V. 


(a) Expand i as a power series in v, retaining terms up to v’. 
(b) Let 
v = 0.01 cos(2zf,,t) + 0.01 cos(2z f.t) volts 


where f,, = 1 kHz and f. = 100 kHz. Determine the spectrum of the 
resulting diode current i. 

(c) Specify the band-pass filter required to extract from the diode cur- 
rent an AM wave with carrier frequency fe. 

(d) What is the percentage modulation of this AM wave? 


Problem 5 Suppose nonlinear devices are available for which the output 
i, and input voltage v; are related by 


ig = av; + a30} 


10 milliseconds 


Figure P7.2 
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where a, and a; are constants. Explain how these devices could be used 
to provide an amplitude modulator. 


Problem 6 Consider the amplitude-modulated wave of Fig. P7.2 with a 
periodic triangular envelope. This modulated wave is applied to an en- 
velope detector with zero source resistance and a load resistance of 250 
ohms. The carrier frequency f, = 40 kHz. Suggest a suitable value for the 
capacitor C so that the distortion (at the envelope detector output) is 
negligible for frequencies up to and including the eleventh harmonic of the 
modulating wave. 


P7.2 Double-Sideband Suppressed-Carrier Modulation 


Problem 7 Consider the DSBSC modulated wave obtained by using the 
sinusoidal modulating wave 


m(t) = Am cos(27f mt) 
and the carrier wave 
c(t) = A, cos(2nf.t + ¢) 
The phase angle ¢, denoting the phase difference between c(t) and m(t) 


at time £ = 0, is variable. Sketch this modulated wave for the following 
values of ¢: 


(a) 6 = 0 

(b) ġ = 45° 
(c) d = 90° 
(d) ¢ = 135° 


Comment on your results. 


Problem 8 A sinusoidal wave of frequency 5 kHz is applied to a product 
modulator, together with a carrier wave of frequency 1 MHz. The mod- 
ulator output is next applied to the resonant circuit of Fig. P7.1. Determine 
the modulated wave after transmission through this circuit. 


Problem 9 Using the message signal m(t) described in Problem 3 deter- 
mine and sketch the modulated wave for DSBSC modulation. 


Problem 10 Given the nonlinear devices described in Problem 5, explain 
how they could be used to provide a product modulator. 


Problem 11 A message signal m(t) is applied to a ring modulator. The 
amplitude spectrum of m(t) has the value M(0) at zero frequency. Find 
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the ring modulator output at f = +f., +3f,, =5f,,..., where f, is the 
fundamental frequency of the square carrier wave c(t). 


Problem 12 Consider a message signal m(t) with the spectrum shown in 
Fig. P7.3. The message bandwidth W = 1 kHz. This signal is applied to 
a product modulator, together with a carrier wave A, cos(27f ,t), producing 
the DSBSC modulated wave s(t). This modulated wave is next applied to 
a coherent detector. Assuming perfect synchronism between the carrier 
waves in the modulator and detector, determine the spectrum of the de- 
tector output when: (a) the carrier frequency f, = 1.25 kHz and (b) the 
carrier frequency fe = 0.75 kHz. What is the lowest carrier frequency for 
which each component of the modulated wave s(t) is uniquely determined 
by m(t)? 


Problem 13 A DSBSC wave is demodulated by applying it to a coherent 
detector. 


(a) Evaluate the effect of a frequency error Af in the local carrier 
frequency of the detector, measured with respect to the carrier frequency 
of the incoming DSBSC wave. 

(b) For the case of a sinusoidal modulating wave, show that because of 
this frequency error, the demodulated wave exhibits beats at the error 
frequency. Illustrate your answer with a sketch of this demodulated 
wave. 


Problem 14 Consider a composite wave obtained by adding a nonco- 
herent carrier A, cos(2zf,t + ġ) to a DSBSC wave cos(2zf ,t)m(t). This 
composite wave is applied to an ideal envelope detector. Find the resulting 
detector output. Evaluate this output for 


(a) ọ = 0. 
(b) ¢ ¥ 0 and |m(t)| < A,/2. 


Mif) 


Figure P7.3 
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P7.3 Quadrature-Carrier Multiplexing 


Problem 15 Consider the quadrature-carrier multiplex system of Fig. 
7.16. The multiplexed signal s(t) produced at the transmitter output in part 
a of this figure is applied to a communication channel of transfer function 
H(f). The output of this channel is in turn applied to the receiver input 
in part b of Fig. 7.16. Prove that the condition 


HG. f)=A*Ge- TT Wat =— w 


is necessary for recovery of the message signals m,(t) and m,(t) at the 
receiver outputs; f, is the carrier frequency, and W is the message band- 
width. 


Hint: Evaluate the spectra of the two receiver outputs. 


P7.4 Single-Sideband Modulation 


Problem 16 Using the message signal m(t) described in Problem 1, de- 
termine and sketch the modulated waves for single-sideband modulation 
with (a) only the upper sideband transmitted, and (b) only the lower side- 
band transmitted. 


Problem 17 Consider a pulse of amplitude A and duration T. This pulse 
is applied to an SSB modulator, producing the modulated wave s(t). De- 
termine the envelope of s(t), and show that this envelope exhibits peaks 
at the beginning and end of the pulse. 


Problem 18 Consider the two-stage SSB modulator of Fig. 7.18b. The 
input signal consists of a voice signal occupying the frequency band 0.3 — 
3.4 kHz. The two oscillator frequencies have the values f, = 100 kHz and 
f2 = 10 MHz. Specify the following: 


(a) The sidebands of the DSBSC modulated waves appearing at the 
two product modulator outputs. 

(b) The sidebands of the SSB modulated waves appearing at the two 
band-pass filter outputs. 

(c) The passbands and guardbands of the two band-pass filters. 


Problem 19 


(a) Let s,(¢) denote the SSB wave obtained by transmitting only the 
upper sideband, and $,„(t) its Hilbert transform. Show that 


m(t) = = [s,(t) cos(2zf .t) + §,(t) sin(27f.t)] 
and 


mt) = = [$ (t) cos(27 f.t) — s,(t) sin(2zf,t)] 
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where m(t) is the message signal, /(t) is its Hilbert transform, f, the 
carrier frequency, and A, is the carrier amplitude. 

(b) Show that the corresponding equations in terms of the SSB wave 
sı(t) obtained by transmitting only the lower sideband are 


m(t) = =. [s,(t) cos(2xf.t) + s(t) sin(2zf,t)] 


and 


mt) = -= [s,(t) sin(2zf .t) — §,(t) cos(27f.t)] 


(c) Using the results of (a) and (b), set up the block diagram of a receiver 
for demodulating an SSB wave. 


Problem 20 


(a) Consider a message signal m(t) containing frequency components 
at 100, 200, and 400 Hz. This signal is applied to an SSB modulator 
together with a carrier at 100 kHz, with only the upper sideband re- 
tained. In the coherent detector used to recover m(t), the local oscillator 
supplies a sine wave of frequency 100.02 kHz. Determine the frequency 
components of the detector output. 

(b) Repeat your analysis, assuming that only the lower sideband is 
transmitted. 


P7.5 Vestigial Sideband Modulation 


Problem 21 The single-tone modulating wave m(t) = Am cos(27f mt) is 
used to generate the VSB modulated wave 


s(t) = @A,,A, cos[2x(f. + fn)t] #AwA-(1 — @) cos[2z(f. — fn)t] 


where a is a constant, less than unity. 


(a) Find the in-phase and quadrature components of the VSB modu- 
lated wave s(t). 

(b) What is the value of constant a for which s(t) reduces to a DSBSC 
modulated wave? 

(c) What are the values of constant a for which it reduces to an SSB 
modulated wave? 

(d) The VSB wave s(t), plus the carrier A, cos(27f,t), is passed through 
an envelope detector. Determine the distortion produced by the quad- 
rature component. 

(e) What is the value of constant a for which this distortion reaches its 
worst possible value? 
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P7.7 Frequency Translation 


Problem 22 Figure P7.4 shows the amplitude spectrum of an SSB-mod- 
ulated signal s(t). The signal s(t) is applied to a mixer. Specify the param- 
eters of the filter and local oscillator components of the mixer to do the 
following: 


(a) Upconversion from 10 to 100 MHz. 
(b) Downconversion from 10 to 1 MHz. 


Problem 23 The spectrum of a voice signal m(t) is zero outside the 
interval fa < |f| < f,. To ensure communication privacy, this signal is 
applied to a scrambler that consists of the following cascade of components: 
a product modulator, a high-pass filter, a second product modulator, and 
a low-pass filter. The carrier wave applied to the first product modulator 
has a frequency equal to f., whereas that applied to the second product 
modulator has a frequency equal to f, + f.; both of them have unity 
amplitude. The high-pass and low-pass filters have the same cutoff fre- 
quency at f.. Assume that f, > fy. 


(a) Derive an expression for the scrambler output s(t), and sketch its 
spectrum. 

(b) Show that the original voice signal m(t) may be recovered from s(t) 
by using a descrambler that is identical to the scrambler. 


P7.8 Frequency-Division Multiplexing 


Problem 24 The practical implementation of an FDM system usually 
involves many steps of modulation and demodulation. The first multiplex- 
ing step combines 12 voice inputs into a basic group, which is formed by 
having the nth input modulate a carrier at frequency f, = 112 kHz — 4n, 
where n = 1, 2, ..., 12. The lower sidebands are then selected by 
band-pass filtering and are combined to form a group of 12 lower side- 
bands (one for each voice input). The next step in the FDM hierarchy 
involves the combination of 5 basic groups into a supergroup. This is 


=i 10 0 10 11 f, MHz 
Figure P7.4 
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accomplished by using the nth group to modulate a carrier at frequency 
fe = 372 + 48n kHz, where n = 1, 2,..., 5. Here again the lower 
- sidebands are selected by filtering and are then combined to form a 
supergroup. In a similar manner, supergroups are combined into master- 
groups, and mastergroups are combined into very large groups. 


(a) Find the frequency band occupied by a basic group. 

(b) Find the frequency band occupied by a supergroup. 

(c) How many independent voice inputs does a supergroup accom- 
modate? 


P7.9 Application I 


Problem 25 Figure P7.5 shows the block diagram of a heterodyne spec- 
trum analyzer. It consists of a variable-frequency oscillator, multiplier, 
band-pass filter, and root mean-square (rms) meter. The oscillator has an 
amplitude A and operates over the range fo to fọ + W, where feo is the 
midband frequency of the filter and W is the signal bandwidth. Assume 
that fọ = 2W, the filter bandwidth 4 f is small compared with fọ, and the 
passband amplitude response of the filter is one. Determine the value of 
the rms meter output for a low-pass input signal g(t). 


Problem 26 Figure P7.6 shows the block diagram of a frequency syn- 
thesizer, which enables the generation of many frequencies, each with the 
same high accuracy as the master oscillator. The master oscillator of fre- 
quency 1 MHz feeds two spectrum generators, one directly and the other 
through a frequency divider. Spectrum generator 1 produces a signal rich 
in the following harmonics: 1, 2, 3, 4, 5, 6, 7, 8, and 9 MHz. The frequency 
divider provides a 100-kHz output, in response to which spectrum generator 
2 produces a second signal rich in the following harmonics: 100, 200, 300, 
400, 500, 600, 700, 800, and 900 kHz. The harmonic selectors are designed 
to feed two signals into the mixer, one from spectrum generator 1 and the 
other from spectrum generator 2. Find the range of possible frequency 
outputs of this synthesizer and its resolution. 


Band-pass 
filter 


Input signal 
git) 


Output 
signal 


Variable 
frequency 
oscillator 


Figure P7.5 
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Spectrum Harmonic 
generator selector 
1 1 


Master 
oscillator 
1 MHz 


+ 10 Spectrum Harmonic 
frequency generator selector 
divider 2 2 


Figure P7.6 


Problem27 The use of quadrature-carrier multiplexing provides the basis 
for the generation of AM stereo signals. One particular form of such a 
signal is described by 


s(t) = A,[cos(2zf.t) + m(t) cos(2zf.t — do) 
+ m,(t) cos(2zf,t + o)] 


where A,cos(2zf,t) is the unmodulated carrier, the phase difference 
$o = 15°, and m,(t) and m,(t) are the outputs of the left- and right-hand 
loudspeakers respectively. With m,(t) and m,(t) as inputs, do the follow- 
ing: 


(a) Set up the block diagram of a system for generating the multiplexed 
signal s(t). 

(b) With s(¢) as input, set up the block diagram of a system for re- 
covering m((t) and m,(t). 

(c) Suppose s(¢) is applied to an envelope detector. What is the resulting 
output? 


Problem 28 Figure 7.33a shows the simplified block diagram of a color 
television transmitter that generates the composite video signal m(t) de- 
scribed by Eq. 7.89. The block diagram of the corresponding demulti- 
plexing system, used in the receiver to recover the original primary color 
signals, is shown in Fig. 7.33b. Starting with the input m(t), analyze the 
operation of the demultiplexing system shown in Fig. 7.33b. 


P7.10 Angle Modulation: Basic Concepts 


Problem 29 Sketch the PM and FM waves produced by the sawtooth 
wave shown in Fig. P7.7. 


Problem 30 In a frequency-modulated radar the instantaneous frequency 
of the transmitted carrier is varied as in Fig. P7.8. Such a signal is generated 
by frequency modulation with a periodic triangular modulating wave. The 
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m(t) 


Figure P7.7 


instantaneous frequency of the received echo signal is shown dashed in 
Fig. P7.8 where z is the round-trip delay time. The transmitted and received 
echo signals are applied to a mixer, and the difference frequency component 
is retained. Assuming that fyt < 1, determine the number of beat cycles 
at the mixer output, averaged over 1 s, in terms of the peak deviation 4 f 
of the carrier frequency, the delay t, and the repetition frequency fọ of 
the transmitted signal. 


Problem 31 The instantaneous frequency of a sine wave is equal to 
fe + Af for |t| < 7/2, and f, for |t| > 7/2. Determine the spectrum of 
this frequency-modulated wave. 


Hint: Divide up the time interval of interest into three nonoverlapping 
regions) = @ < ¢< =7/2, —T/2=¢s 7/2, and 7/2 <t< 


Problem 32 Consider an interval 4t of an FM wave s(t) = A, cos[0(t)] 
such that 0(¢) satisfies the condition 


Ot + At)h-— Ot) =r 


Transmitted 


Figure P7.8 
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Hence, show that if 4t is sufficiently small, the instantaneous frequency of 
the FM wave inside this interval is approximately given by 


Problem 33 Consider the signal 
x(t) = A, cos(27f ,t) + A; cos(2z7f;t) 


where A, cos(27f,.t) represents an unmodulated carrier, and A; cos(27f ;t) 
represents an interfering signal. Assume that the amplitude ratio A,/A, is 
small compared to unity. Calculate the instantaneous frequency of x(t) 
under this assumption. 


Problem 34 Consider a narrow-band FM wave approximately defined by 


s(t) = A, cos(2nf,t) — BA, sin(2zf,t) sin(27f mt) 


(a) Determine the envelope of this modulated wave. What is the ratio 
of the maximum to the minimum value of this envelope? Plot this ratio 
versus f, assuming that £ is restricted to the interval 0 < £ < 0.3. 

(b) Determine the average power of the narrow-band FM wave, ex- 
pressed as a percentage of the average power of the unmodulated carrier 
wave. Plot this result versus f, assuming that £ is restricted to the interval 
0<f£<0.3. 

(c) By expanding the angular argument 6(t) of the narrow-band FM 
wave s(t) in the form of a power series, and restricting the modulation 
index f to a maximum value of 0.3 rad, show that 


O(t) = 2nf.t + Bsin(2zf,,t) — E sin? Qnf at) 


What is the value of the harmonic distortion for B = 0.3? 
Problem 35 The sinusoidal modulating wave 
m(t) = Am cos(27f mt) 
is applied to a phase modulator with phase sensitivity k,- The unmodulated 
carrier wave has frequency f. and amplitude A,. Determine the spectrum 


of the resulting phase-modulated wave, assuming that the maximum phase 
deviation $, = k,A,, does not exceed 0.3 rad. 


Problem 36 Suppose that the phase-modulated wave of Problem 35 has 
an arbitrary value for the maximum phase deviation pp- This modulated 
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wave is applied to an ideal band-pass filter with midband frequency f, and 
a passband extending from f, — 1.5f,, to fe + 1.5f,,. Determine the 
envelope, phase, and instantaneous frequency of the modulated wave at 
the filter output as functions of time. 


Problem 37: A carrier wave is frequency-modulated using a sinusoidal 
signal of frequency f,, and amplitude A,,. 


(a) Determine the values of the modulation index f for which the carrier 
component of the FM wave is reduced to zero. For this calculation you 
may use the values of J)(f) given in Appendix B. 

(b) In a certain experiment conducted with f,, = 1 kHz and increasing 
A,, (starting from 0 V), it is found that the carrier component of the 
FM wave is reduced to zero for the first time when A,, = 2 V. What is 
the frequency sensitivity of the modulator? What is the value of A,, for 
which the carrier component is reduced to zero for the second time? 


Problem 38 A carrier wave of frequency 100 MHz is frequency-modu- 
lated by a sine wave of amplitude 20 V and frequency 100 kHz. The 
frequency sensitivity of the modulator is 25 kHz/V. 


(a) Determine the approximate bandwidth of the FM wave, using Car- 
son’s rule. 

(b) Determine the bandwidth by transmitting only those side-frequen- 
cies with amplitudes that exceed 1% of the unmodulated carrier am- 
plitude. Use the universal curve of Fig. 7.41 for this calculation. 

(c) Repeat your calculations, assuming that the amplitude of the mod- 
ulating wave is doubled. 

(d) Repeat your calculations, assuming that the modulation frequency 
is doubled. 


Problem 39 Consider a wideband PM wave produced by a sinusoidal 
modulating wave A,, cos(27f,,¢), using a modulator with a phase sensitivity 
equal to k, radians per volt. 


(a) Show that if the maximum phase deviation of the PM wave is large 
compared with 1 rad, the bandwidth of the PM wave varies linearly with 


the modulation frequency fm. 
(b) Compare this characteristic of a wideband PM wave with that of a 


wideband FM wave. 


Problem 40 In this problem we investigate the effect of a weak nonlin- 
earity on frequency modulation. Specifically, consider a memoryless chan- 
nel the transfer characteristic of which is described by the nonlinear re- 
lation: 


Uo(t) = ayu,(t) + aw? (t) + azv? (t) 
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where u,(t) and v,(t) are the input and output signals, respectively, and 
a,, à, and a; are constant coefficients. Let 


u(t) = A, cos[2xf,t + (t)] 


where ¢(t) is related to the message signal m(t) by 


g= 2k; i ‘ m(t) dt 


(a) Show that the channel output v,(¢) contains a de component and 
three frequency-modulated waves with carrier frequencies f., 2f, and 
oe 

(b) To extract an FM wave the same as that at the channel input, except 
for a change in carrier amplitude, show that by using Carson’s rule the 
carrier frequency f. must satisfy the following condition: 


fo a SAh ae 2A 


where W is the highest frequency component of the message signal m(t) 
and 4f is the frequency deviation of the FM wave v;(t). 

(c) Specify the band-pass filter required to do the extraction of the FM 
wave as specified in part (b). 


Problem 41 Figure P7.9 shows the frequency-determining network of a 
voltage-controlled oscillator. Frequency modulation is produced by apply- 
ing the modulating wave A, sin(27f,,t) plus a bias V, to a pair of varactor 
diodes connected across the parallel combination of a 200 wH inductor and 
100 pF capacitor. The capacitance of each varactor diode is related to the 
voltage V (in volts) applied across its electrodes by 


C = 100V -'” pF 
The unmodulated frequency of oscillation is 1 MHz. The VCO output is 


applied to a frequency multiplier to produce an FM wave with a carrier 
frequency of 64 MHz and a modulation index of 5. 


Figure P7.9 
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Figure P7.10 


Determine: (a) the magnitude of the bias voltage V,, and (b) the am- 
plitude A,, of the modulating wave, given that f,, = 10 kHz. 


Problem 42 The FM wave 


s(t) =A, cos| ft + 27k; fmo a 


is applied to the system shown in Fig. P7.10 consisting of a high-pass RC 
filter and an envelope detector. Assume that: (a) the resistance R is small 
compared with the reactance of the capacitor C for all significant frequency 
components of s(t), and (b) the envelope detector does not load the filter. 
Determine the resulting signal at the envelope detector output, assuming 
that k,|m(t)| < f. for all t. 


Problem 43 Consider the frequency demodulation scheme shown in Fig. 
P7.11 in which the incoming FM wave s(t) is passed through a delay line 
that produces a phase shift of —z/2 radians at the carrier frequency f.. 
The delay-line output is subtracted from the incoming FM wave, and the 
resulting composite wave is then envelope-detected. This demodulator finds 
wide application in demodulating FM waves at microwave frequencies. 
Assuming that 


s(t) = A, cos[2zf,t + $ sin(2Qzf,,t)| 


analyze the operation of this demodulator when the modulation index £ is 
less than unity and the delay T produced by the delay line is sufficiently 


Output 
signal 


Envelope 
detector 


Figure P7.11 
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small to justify making the approximations: 
cos(2nfmT) = 1 


and 


sin(27f ,T) = 2nf »T 


P7.12 Phase-Locked Loop 


Problem 44 A first-order PLL is used to demodulate a single-tone FM 
wave that has the following characteristics: 


Modulation index $ = 5 
Modulation frequency f,, = 15 kHz 


(a) Suggest a suitable value for the loop parameter K, of the PLL. 
(b) For the value chosen in part (a), what is the corresponding value 
of the loop bandwidth? 

(c) Suggest a method for reducing the loop bandwidth. 


Problem 45 Show that a second-order PLL using the loop filter shown 
in Fig. 7.55 has the following closed-loop transfer function: 


BAF) _ Cif! fx)? 
DF) 1+ XCf/F,) + GIFY 


where f, is the natural frequency of the loop and ¢ is the damping factor; 


they are defined by 
aP AS 
= Vag 


How does this PLL differ from a first-order PLL? 


Problem 46 Figure P7.12 shows the cascade connection of a phase-locked 
loop and a linear filter. A phase-modulated wave is applied to the input 


Phase- 


modulated Message 
wave g Linear filter, signal 
i ked transfer function 
H(f) 


Figure P7.12 
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of the phase-locked loop. The requirement is to reproduce the message 
signal at the output of the filter. Find the transfer function H(f) of the 
filter that satisfies this requirement, assuming that the phase-locked loop 
has a large loop gain. 


P7.13 Limiting of FM Waves 
Problem 47 Consider the modulated signal 


S,(t) = a(t) cos[2zf,t + 2nk, fmo dt] 


where a(t) is a slowly varying envelope function, f. is the carrier frequency, 
k; is a frequency sensitivity, and m(t) is a message signal. The modulated 
signal s(t) is processed by a band-pass limiter (consisting of a hard limiter 
followed by a band-pass filter) to remove amplitude fluctuations due to 
a(t). Specify the parameters of the band-pass filter component so as to 
produce the FM wave 


s(t) = A cusf2nf.t + Ink, Í Ooa] 
0 
where A is a constant amplitude. 


P7.14 Application Il 


Problem 48 Consider the analysis of FM stereo transmission, assuming 
that the left-hand and right-hand signals consist of two tones of different 
frequencies but the same amplitude, as shown by 


m(t) = A, cos(2r fit) 
and 
m,(t) = Am cos(27f,t) 


(a) Show that the amplitude of a composite signal consisting of the sum 
signal and the DSBSC modulated version of the difference signal is 
bounded by 2A „m; that is: 


|m(t) + m,(t) + [m(t) — m,(t)] cos(4zfect)| < 2A m 


where f,, is the subcarrier frequency. 

(b) Let A,, = 0.45, and let the pilot (of frequency f.c) injected into 
the multiplexed FM stereo signal have amplitude A. = 0.1. Let the 
FM wave produced by this multiplexed signal have frequency deviation 
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Af = 75 kHz. Find the effective frequency deviation that results from 
the reception of the FM wave by a monophonic receiver that responds 
only to the sum signal. 


Problem 49 Figure P7.13 shows the block diagram of a real-time spectrum 
analyzer working on the principle of frequency modulation. The given 
signal g(t) and a frequency-modulated signal s(t) are applied to a multiplier 
and the output g(t)s(t) is fed into a filter of impulse response h(t). The 
s(t) and h(t) are linear FM signals whose instantaneous frequencies vary 
at opposite rates, as shown by 


s(t) = cos(2zf,t — nkt?) 
and 
h(t) = cos(2zf,t + nkt?) 


where k is a constant. Show that the envelope of the filter output is pro- 
portional to the amplitude spectrum of the input signal g(t) with kt playing 
the role of frequency f. 


Hint: Use the complex notations described in Section 3.5 for band-pass 
transmission. 


P7.15 Digital Modulation Techniques 


Problem 50 Sketch the binary ASK waveform for the sequence 1011010011. 
Assume that the carrier frequency f, equals the bit rate 1/T7,. 


Problem 51 Repeat Problem 50 using binary PSK. 
Problem 52 Sketch the binary FSK waveform for the sequence 1011010011. 


Assume that the two frequencies used to represent symbols 1 and 0 are 
given by, respectively, 


eo T 


s(t) 
Figure P7.13 
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and 


fj =r 


where T, is the bit duration. 


Problem 53 Both binary FSK and binary PSK signals have a constant 
envelope. Yet binary FSK signals can be noncoherently detected, whereas 
binary PSK signals cannot be. What are the reasons for this difference? 


Problem 54 The binary sequence 1011010011 is transmitted over a com- 
munication channel using DPSK. The channel introduces a 180°-phase 
reversal. 


(a) Sketch the transmitted DPSK waveform, assuming an initial bit of 
1. What is the effect of changing the initial bit to a 0? 

(b) Assuming that the channel is noise-free, show that the DPSK de- 
tector in the receiver reproduces the original binary sequence, despite 
the 180°-phase reversal in the channel. 


Problem 55 Set up a circuit for generating a differentially encoded se- 
quence (that includes the initial bit) in response to an incoming binary 
sequence. Is the structure of this circuit affected by the identity of the initial 
bit? 


Problem 56 Sketch the QPSK waveform for the sequence 1011010011. 
You may assume the following: 


(a) The carrier frequency equals the bit rate. 
(b) The dibits 00, 10, 11, and 01 are represented by phase shifts equal 
to 0, 2/2, x, 37/2 radians. 


Problem 57 Sketch the waveform of the MSK signal for the sequence 
1011010011. Assume that the carrier frequency equals the bit rate. 
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ROBABILITY THEORY 


ye term “random” is used to describe erratic and apparently 
unpredictable variations of an observed signal. Indeed, random signals 
(in one form or another) are encountered in every practical 
communication system. Consider, for example, a radio communication 
system. The received signal in such a system is random in nature. 
Ordinarily, the received signal consists of an information-bearing signal 
component, a random-interference component, and receiver noise. The 
information-bearing signal component may represent, for example, a 
voice signal that, typically, consists of randomly spaced bursts of energy 
of random duration. The interference component represents the extraneous 
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electromagnetic waves produced by other communication systems and at- 
mospheric electricity. A major type of noise is thermal noise, which is 
caused by the random motion of the electrons in conductors and devices 
at the front end of the receiver. 

The important point is that, regardless of the underlying causes of ran- 
domness, we cannot predict the exact value of the received signal. Never- 
theless, the received signal can be described in terms of its statistical prop- 
erties such as the average power, or the spectral distribution of the average 
power. The mathematical discipline that deals with the statistical charac- 
terization of random signals is probability theory.' We begin our discussion 
of random signals with a review of probability theory in the next section. 


ecccescescesescces 38.1 PROBABILITY THEORY 


Probability theory is rooted in situations that involve performing an ex- 
periment with an outcome that is subject to chance. Moreover, if the 
experiment is repeated, the outcome can differ because of the influence of 
an underlying random phenomenon or chance mechanism. Such an ex- 
periment is referred to as a random experiment. For example, the exper- 
iment may be the observation of the result of the tossing of a fair coin. In 
this experiment, the possible outcomes of a trial are “heads” or “tails.” 

To be more precise in the description of a random experiment, we ask 
for three features: 


1. The experiment is repeatable under identical conditions. 

2. On any trial of the experiment, the outcome is unpredictable. 

3. For a large number of trials of the experiment, the outcomes exhibit 
statistical regularity. That is, a definite average pattern of outcomes is 
observed if the experiment is repeated a large number of times. 


RELATIVE-FREQUENCY APPROACH 


Let event A denote one of the possible outcomes of a random experiment. 
For example, in the coin-tossing experiment, event A may represent 
“heads.” Suppose that in n trials of the experiment, event A occurs na 
times. We may then assign the ratio n,/n to the event A. This ratio is 
called the relative frequency of the event A. Clearly, the relative frequency 


'For a detailed treatment of probability theory and the related subject of 
random processes, see Davenport and Root (1958), Fry (1965), Thomas (1986), 
Wozencraft and Jacobs (1965), Feller (1968), Fines (1973), Blake (1979), and 
Papoulis (1984). 
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is a nonnegative real number less than or equal to one. That is to say, 


a at (8.1) 
n 
If event A occurs in none of the trials, (n,/n) = 0. If, on the other hand, 
event A occurs in all the n trials, (n4/n) = 1. 

We say that the experiment exhibits statistical regularity if for any se- 
quence of n trials the relative frequency n,/n converges to the same limit 
as n becomes large. Accordingly, it seems natural for us to define the 


probability of event A as 


P(A) = lim (z) (8.2) 


row 


Thus, in the coin-tossing experiment, we may expect that out of a million 
tosses of a fair coin, about one half of them will show up heads. 

The probability of an event is intended to represent the likelihood that 
a trial of the experiment will result in the occurrence of that event. For 
many engineering applications and games of chance, the use of Eq. 8.2 to 
define the probability of an event is acceptable. However, for many other 
applications this definition is inadequate. Consider, for example, the sta- 
tistical analysis of the stock market: How are we to achieve repeatability 
of such an experiment? A more satisfying approach is to state the properties 
that any measure of probability is expected to have, postulating them as 
axioms, and then use relative-frequency interpretations to justify them. 


AXIOMS OF PROBABILITY 


When we perform a random experiment, it is natural for us to be aware 
of the various outcomes that are likely to arise. In this context, it is con- 
venient to think of an experiment and its possible outcomes as defining a 
space and its points. With each possible outcome of the experiment, we 
associate a point called the sample point, which we denote by s,. The 
totality of sample points corresponding to the aggregate of all possible 
outcomes of the experiment, is called the sample space, which we denote 
by ©. An event corresponds to either a single sample point or a set of 
sample points. In particular, the entire sample space © is called the sure 
event; the null set 0 is called the null or impossible event; and a single 
sample point is called an elementary event. 

Consider, for example, an experiment that involves the throw of a die. 
In this experiment there are six possible outcomes: the showing of one, 
two, three, four, five and six dots on the upper face of the die. By assigning 
a sample point to each of these possible outcomes, we have a one-dimen- 
sional sample space that consists of six sample points, as shown in Fig. 8.1. 
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Sample point 
x 


—eoe o e o o oeo 
1 2 3 4 5 6 


One-dimensional sample space 


Figure 8.1 
Sample space for the experiment of throwing a die. 


The elementary event describing the statement “a six shows” corresponds 
to the sample point {6}. On the other hand, the event describing the state- 
ment “an even number of dots shows” corresponds to the subset {2,4,6} 
of the sample space. Note that the term “event” is used interchangeably 
to describe the subset or the statement. 

We are now ready to make a formal definition of probability. A prob- 
ability system consists of the triple: 


1. A sample space © of elementary events (outcomes). 
2. A class & of events that are subsets of S. 


3. A probability measure P(-) assigned to each event A in the class &, 
which has the following properties: 


(i) P(®) = 1 (8.3) 
(ii) 0 < P(A) <1 (8.4) 
(iii) If A + B is the union of two mutually exclusive events in the class 

&, then 
P(A + B) = P(A) + P(B) (8.5) 


Properties (i), (ii), and (iii) are known as the axioms of probability. Axiom 
(i) states that the probability of the sure event is unity. Axiom (ii) states 
that the probability of an event is a nonnegative real number that is less 
than or equal to unity. Axiom (iii) states that the probability of the union 
of two mutually exclusive events is the sum of the probabilities of the 
individual events. 

Although the axiomatic approach to probability theory is abstract in 
nature, all three axioms have relative-frequency interpretations of their 
own. Axiom (ii) corresponds to Eq. 8.1. Axiom (i) corresponds to the 
limiting case of Eq. 8.1 when the event A occurs in all the n trials. To 
interpret axiom (iii), we note that if event A occurs n, times in n trials 
and event B occurs npg times, then the union event “A or B” occurs in 
Na + ng trials (since A and B can never occur on the same trial). Hence, 
Na+p = Ng + npg, and so we have 


which has a mathematical form similar to that of axiom (iii). 


PROBABILITY THEORY 407 


ELEMENTARY PROPERTIES OF PROBABILITY 


Axioms (i), (ii), and (iii) constitute an implicit definition of probability. 
We may use these axioms to develop some other basic properties of prob- 
ability. 


PROPERTY 1: P(A) = 1 — P(A) (8.6) 


where A (denoting “not A”) is the complement of event A. 


The use of this property helps us investigate the nonoccurrence of an event. 
To prove it, we express the sample space © as the union of two mutually 
exclusive events A and A: 


S=A+A 
Then, the use of axioms (i) and (iii) yields 
1 = P(A) + P(A) 


from which Eq. 8.6 follows directly. 


PROPERTY 2 


If M mutually exclusive events A,, A2,..., Am have the exhaustive property 
A, + Apt + Ay =o (8.7) 

then 

P(A,) + P(A,) + ++ + P(Ay) = 1 (8.8) 
To prove this property, we generalize axiom (iii) by writing 

P(A, + A, + «+ + Ay) = P(A,) + P(A2) + © + P(Am) 
The use of axiom (i) in Eq. 8.7 yields 
P(A, + Ap + > + Ay) = 1 


Hence, the result of Eq. 8.8 follows. ap 
When the M events are equally likely (i.e., they have equal probabili- 
ties), then Eq. 8.8 simplifies as 


P(A,;) = i=1,2,...,M (8.9) 


a 
M’ 
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PROPERTY 3 


When events A and B are not mutually exclusive, then the probability of the 
union event “A or B” equals 


P(A + B) = P(A) + P(B) — P(AB) (8.10) 


where P(AB) is the probability of the joint event “A and B”. 


The probability P(AB) is called the joint probability. It has the following 
relative-frequency interpretation 


P(AB) = lim (=) 


where n4g denotes the number of times the events A and B occur simul- 
taneously in n trials of the experiment. Axiom (iii) is a special case of Eq. 
8.10; when A and B are mutually exclusive, P(AB) is zero, and Eq. 8.10 
reduces to the same form as Eq. 8.5. 


— EXERCISE 1 Consider an experiment in which two coins are thrown. 
_ What is the probability of getting one head and one tail? — 


_ EXERCISE 2 Consideran experiment in which two dice are thrown. What 
o's the. probability that the number of dots showing on the upper faces of 
E the two dice add up HOOP uc 


CONDITIONAL PROBABILITY 


Suppose we perform an experiment that involves a pair of events A and 
B. Let P(B|A) denote the probability of event B, given that event A has 
occurred. The probability P(B|A) is called the conditional probability of 
B given A. Assuming that A has nonzero probability, the conditional prob- 
ability P(B|A) is defined by 


P(AB) 


P(B|A) = ae 


(8.11) 


where P(AB) is the joint probability of A and B. 

We justify the definition of conditional probability given in Eq. 8.11 by 
presenting a relative-frequency interpretation of it. Suppose that we per- 
form an experiment and examine the occurrence of a pair of events A and 
B. Let n,, denote the number of times the joint event AB occurs in n 
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trials. Suppose that in the same n trials the event A occurs n; times. Since 
the joint event AB corresponds to both A and B occurring, it follows that 
n, must include n4,. In other words, we have 


n 
ZABT] 
na 


The ratio n4g/n4 represents the relative frequency of B given that A has 
occurred. For large n, the ratio n4g/n, equals the conditional probability 
P(B|A). That is, 


NAB 
P(B|A) = = lim (‘ue 


n=% 


or equivalently, 
i. pen 

ARa am (z) 

Recognizing that 
: Nap 
P(AB) = lim (=) 
and 
Sy ill 
ra= infe 
the result of Eq. 8.11 follows. 
We may rewrite Eq. 8.11 as 

P(AB) = P(B|A)P(A) (8.12) 
It is apparent that we may also write 

P(AB) = P(A|B)P(B) (8.13) 
Equations 8.12 and 8.13 state that the joint probability of two events may 
be expressed as the product of the conditional probability of one event, given 
the other, and the elementary probability of the other. Note that the con- 
ditional probabilities P(B|A) and P(A|B) have essentially the same prop- 
erties as the various probabilities previously defined. 

Situations may exist where the conditional probability P(A|B) and the 


probabilities P(A) and P(B) are easily determined directly, but the con- 
ditional probability P(B|A) is desired. From Eqs. 8.12 and 8.13, it follows 
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that, provided P(A) # 0, we may determine P(B|A) by using the relation 


P(A|B)P(B) 


PA (8.14) 


RA) = 


This relation is a special form of Bayes’ rule. 
Suppose that the conditional probability P(B|A) is simply equal to the 
elementary probability of occurrence of event B, that is, 


P(BIA) = P(B) (8.15) 


Under this condition, the probability of occurrence of the joint event AB 
is equal to the product of the elementary probabilities of the events A 
and B: 


P(AB) = P(A)P(B) 
so that 
P(A|B) = P(A) 


That is, the conditional probability of the event A, assuming the occurrence 
of the event B, is simply equal to the elementary probability of the event 
A. We thus see that in this case a knowledge of the occurrence of one 
event tells us no more about the probability of occurrence of the other 
event than we knew without that knowledge. Events A and B that satisfy 
this condition are said to be statistically independent. 
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EXAMPLE 1 BINARY SYMMETRIC CHANNEL 


Consider a discrete memoryless channel used to transmit binary data. The 
channel is said to be discrete in that it is designed to handle discrete mes- 
sages. It is memoryless in the sense that the channel output at any time 
depends only on the channel input at that time. Owing to the unavoidable 
presence of noise in the channel, errors are made in the received binary 
data stream. Specifically, when symbol 1 is sent, occasionally an error is 
made and symbol 0 is received, and vice versa. The channel is assumed to 
be symmetric, which means that the probability of receiving symbol 1 when 
symbol 0 is sent is the same as the probability of receiving symbol 0 when 
symbol 1 is sent. 

To describe the probabilistic nature of this channel fully, we need two 
sets of probabilities: 


1. The a priori probabilities of sending binary symbols 0 and 1: They are 
P(Ao) = Po (8.16) 
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and 
P(A,) = pı (8.17) 
where A, and A, denote the events of transmitting symbols 0 and 1, 
respectively. Note that py + pı = 1. 
2. The conditional probabilities of error: They are 

P(B,|Ao) = P(Bo|A1) = p (8.18) 
where Bo and B, denote the events of receiving symbols 0 and 1, re- 
spectively. The conditional probability P(B,|Aj) is the probability of 
receiving symbol 1, given that symbol 0 is sent. The second conditional 
probability P(B,|A,) is the probability of receiving symbol 0, given that 
symbol 1 is sent. 


The requirement is to determine the a posteriori probabilities P(A,| Bo) 
and P(A,|B,). The conditional probability P(A|Bo) is the probability that 
symbol 0 was sent, given that symbol 0 is received. The second conditional 
probability P(A,|B,) is the probability that symbol 1 was sent, given that 
symbol 1 is received. Both these conditional probabilities refer to events 
that are observed “after the fact”; hence, the name “a posteriori” prob- 
abilities. 

Since the events Bọ and B, are mutually exclusive, and the probability 
of receiving symbol 0 or symbol 1 is unity, we have from axiom (iii): 


P(By|Ao) + P(B,|Ao) = 1 
That is to say, 
P(Bo|Ao) = 1- p (8.19) 
Similarly, we may write 
P(B,|A,;) =1-p (8.20) 


Accordingly, we may use the transition probability diagram shown in Fig. 
8.2 to represent the binary communication channel specified in this ex- 


Figure 8.2 l i 
Transition probability diagram of binary symmetric channel. 
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ample; the term “transition probability” refers to the conditional proba- 
bility of error. Figure 8.2 clearly depicts the (assumed) symmetric nature 
of the channel; hence, the name “binary symmetric channel.” 

From Fig. 8.2, we deduce the following results: 


1. The probability of receiving symbol 0 is given by 
P(By) = P(By|Ao) P(Ao) T P(Bo|A1) P(A) 
= (1 — pipe tea (8.21) 
2. The probability of receiving symbol 1 is given by 
P(B,) = P(B,|Ao)P(Ao) ar P(B\|A:)P(A:) 
PPo + (1 — p)pi (8.22) 


Ii 


Therefore, applying Bayes’ rule, we obtain 


P(Bo|4)P(A0) 
P(Bo) 
m (1 — p)po 
~ (1 = p)po + pp: ee) 
P(B,|A,) P(A) 
P(B) 
_ St ape 
ppp + (1 — p)pr oe 


P(A)|Bo) = 
P(A,|B;) a 


These are the desired results. 


. 
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_ EXERCISE 3 Continuing with Example 1, find the si a conditional 
probabilities: P(A |B) and P(A\|Bo)- . 


EXERCISE 4 Consider a binary symmetric channel for which the condi- 
tional probability of error p = 1074, and symbols 0 and 1 occur with ganat 4 
Pura: Calculate the following prob abies: pacer | 


(a) The probability of receiving symbol 0. 

(b) The probability of receiving symbol 1. 

(c) The probability that symbol 0 was sent, given that symbol 0 is re- 
ceived. 

(d) The probability that symbol 1 was sent, given that eae Q is. 
received. : 
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EXAMPLE 2 CHAIN OF PCM REGENERATIVE REPEATERS 


In Section 5.6 we described the use of regenerative repeaters in a pulse- 
code modulation (PCM) system as a means of combatting the effects of 
channel noise. Specifically, the function of a regenerative repeater is two- 
fold: (1) to detect the presence of symbol 0 or 1 before the pulses repre- 
senting these symbols become too weak and therefore lost in channel noise, 
and (2) to retransmit new clean pulses (representing the symbols detected) 
on to the next regenerative repeater. Consider a binary PCM system that 
uses a chain of (k — 1) regenerative repeaters, followed by one last re- 
generation at the receiver input, as illustrated in Fig. 8.3. Given that the 
average probability of error incurred in each regeneration process is P,, 
we wish to calculate the average probability of error Pg for the entire 
system. 

The system may be viewed as the cascade connection of k identical links, 
with each link responsible for an average probability of error P,. A binary 
symbol 1 or 0 sent over such a system is detected correctly at the receiver 
if either the symbol in question is detected correctly over each link in the 
system or it experiences errors over an even number of links. We may thus 
express the probability of correct reception Pc at the receiver output as 


Po=1- Pe 

P(correct detection over all links in the system) 
+ P(error over any two links in the system) 

+ P(error over any four links in the system) 


+ P(error over l links in the system) (8.25) 


where, in the last term, we have 


pe k, if k is even 
~ (k-41, if k is odd 


Given that the probability of error over each link is P,, we may write 


P(correct detection over all links in the system) = (1 — P.)* 


k! : 
P(error over any j links in the system) = E-J! Pi(1 — P.) 


Link 1 
Regenerative 
Transmitter st 
Figure 8.3 


Chain of PCM regenerative repeaters. 


Link k 


Receiver 


Link 2 


Regenerative 
repeater 
k-1 


Regenerative 
repeater 
2 
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Using these results in Eq. 8.25, we get 


l 
k! l 
| [P(e — SS Pi — P26) 
me ) ST (k - j)! ( 


In practice, we usually find that P, is very small compared to unity, so that 
we may make the following two approximations: 


1. We may approximate the first term in Eq. 8.26 as 


vk 
E eni pies EED p? (8.27) 
2. We may approximate the second term in Eq. 8.26 by retaining only that 
term in the summation that corresponds to j = 2, and also writing 
AER) = 


Accordingly, we may approximate Eq. 8.26 as: 
1 =P E Re 1 ye? 
or equivalently 
Pe a Kk — 1)P? (8.28) 


If the number of links k in the system is such that kP, is small compared 
to unity, we may further approximate Eq. 8.28 as 


P; = kP, (8.29) 


That is, the average probability of error in the entire PCM system of Fig. 
8.3 is equal to the average probability of error in a single link of the system 
times the total number of links in the system. 


8.2 RANDOM VARIABLES 


In conducting an experiment it is convenient to assign a variable to the 
experiment whose outcome determines the value of the variable. We do 
so because we may have no a priori knowledge of the outcome of the 
experiment other than it may take on a value within a certain range. A 
function whose domain is a sample space and whose range is some set of 
real numbers is called a random variable of the experiment.? Thus when the 


7The term “random variable” is somewhat confusing: First, because the word 
“random” is not used in the sense of equal probability of occurrence, for 
which it should be reserved. Second, the word “variable” does not imply 
dependence on the experimental outcome, which is an essential part of the 
meaning. Nevertheless, the term is so deeply imbedded in the literature of 
probability that its usage has persisted. 
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outcome of the experiment is s, the random variable is denoted as X(s) 
or simply X. For example, the sample space representing the outcomes of 
the throw of a die is a set of six sample points that may be taken to be the 
integers 1,2,... , 6. Then if we identify the sample point k with the event 
that k dots show when the die is thrown, the function X(k) = kis a random 
variable such that X(k) equals the number of dots that show when the die 
is thrown. In this example, the random variable takes on only a discrete 
set of values. In such a case we say that we are dealing with a discrete 
random variable. More precisely, the random variable X is a discrete ran- 
dom variable if X can take on only a finite number of values in any finite 
observation interval. If, however, the random variable X can take on any 
value in a finite observation interval, X is called a continuous random vari- 
able. For example, the random variable that represents the amplitude of 
a noise voltage at a particular instant of time is a continuous random 
variable because, in theory, it may take on any value between plus and 
minus infinity. 

To proceed further, we need a probabilistic description of random vari- 
ables that works equally well for both discrete and continuous random 
variables. Let us consider the random variable X and the probability of 
the event X < x, when x is given. We denote the probability of this event 
by P(X <x). It is apparent that this probability is a function of the dummy 
variable x. To simplify our notation, we write. 


F,(x) = P(X = o (8.30) 


The function F,(x) is called the cumulative distribution function or simply 
the distribution function of the random variable X. Note that Fy(x) is a 
function of x, not of the random variable X. However, it depends on the 
assignment of the random variable X, which accounts for the use of X as 
subscript. For any point x, the distribution function Fy(x) expresses a 
probability. 

The distribution function Fy(x) has the following properties, which fol- 
low directly from Eq. 8.30: 


1. The distribution function Fy(x) is bounded between zero and one. 
2. The distribution function F,(x) is a monotone nondecreasing function 
of x; that is, 


Fy(x;) = Fy(x2), if SS SS 3S (8.31) 


An alternative description of the probability distribution of the random 
variable X is often useful. This is the derivative of the distribution function, 
as shown by 


fue) = É F(a) (8.32) 
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which is called the probability density function. Note that the differenti- 
ation in Eq. 8.32 is with respect to the dummy variable x. The name, 
density function, arises from the fact that the probability of the event 
x, < X < x, equals 


P(x, = ASES) = P(X =x) ROE) 
Fy(x2) — Fx(%1) 


I * (x) de (8.33) 


Since F(%) = 1, corresponding to the probability of the certain event, 
and Fy(—©) = 0, corresponding to the probability of the impossible event, 
it follows immediately from Eq. 8.33 that 


| era =4 (8.34) 


Also, as mentioned earlier, a distribution function must always be mono- 
tone nondecreasing. Hence, its derivative, the probability density function, 
must always be nonnegative. A probability density function must always be 
a nonnegative function with the total area under its curve equal to one. 
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EXAMPLE 3 UNIFORM DISTRIBUTION 


Consider a random variable X defined by (assuming b > a) 


a 
fx(x) = 5b -a 
0, 


ax=x<=b 


(8.35) 
elsewhere 


This function, shown in Fig. 8.4, satisfies the requirements of a probability 
density because f y(x) = 0, and the area under the curve is unity. A random 
variable having the probability density function of Eq. 8.35 is said to be 
uniformly distributed. 

The corresponding distribution function of the uniformly distributed 
random variable X is continuous everywhere, as shown by 


0, xa 
F,(x) = ' = a<x<b (8.36) 
l; x>b 


This distribution function is plotted in Fig. 8.4b. 
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(b) 


Figure 8.4 
The uniform distribution. (a) Probability density function. (b) Distribution function. 


SEVERAL RANDOM VARIABLES 


Thus far we have focused attention on situations involving a single random 
variable. However, we find frequently that the outcome of an experiment 
requires several random variables to describe the experiment. In the sequel 
we consider situations involving two random variables. The probabilistic 
description developed in this way may be readily extended to any number 
of random variables. : 

Consider two random variables X and Y. We define the joint distribution 
function Fy y(x, y) as the probability that the random variable X is less than 
or equal to a specified value x and that the random variable Y is less than 
or equal to a specified value y. The variables X and Y may be two distinct 
one-dimensional random variables or the components of a single two- 
dimensional random variable. The joint distribution function Fy y(x, y) is 
the probability that the outcome of an experiment will result in a sample 
point lying inside the quadrant (—% < X <x, — œ < Y < y) of the joint- 
sample space. That is, 


Fxy(x, y) = P(X<x, Y<y) (8.37) 


Suppose that the joint distribution function Fy y(x, y) is continuous 
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everywhere, and that the partial derivative 


Fy y(x, y) 


8.3 
ox dy Ce 


fxy(X, y) = 


exists and is continuous everywhere. We call the function fy y(x, y) the 
joint probability density function of the random variables X and Y. The 
joint distribution function Fy y(x, y) is a monotone nondecreasing function 
of both x and y. Therefore, from Eq. 8.38 it follows that the joint prob- 
ability density function fx y(x, y) is always nonnegative. Also, the total 
volume under the graph of a joint probability density function must be 
unity, as shown by 


i a Pxy(6,0) dč dn = 1 (8.39) 


The probability density function for a single random variable (X, say) 
can be obtained from its joint probability density function with a second 
random variable (Y, say) in the following way. We first note that 


Fe(x) = | | faré n) déan (8.40) 


Therefore, differentiating both sides of Eq. 8.40 with respect to x, we get 
the desired relation: 


fal) = | faves) dn (8.41) 


Thus the probability density function f y(x) may be obtained from the joint 
probability density function fx y(x, y) by simply integrating over all pos- 
sible values of the undesired random variable, Y. The use of similar ar- 
guments in the context of the other random variable Y yields f y(y). The 
probability density functions f (x) and f y(y) are called marginal densities. 
Hence, the joint probability density function fx y(x, y) contains all the 
possible information about the joint random variables X and Y. 

Suppose that X and Y are two continuous random variables with joint 
probability density function fx y(x, y). The conditional probability density 
function of Y given that X = x is defined by 


_ je ee) 
fr(y|X = x) F(x) (8.42) 


provided that f(x) > 0, where f(x) is the marginal density of X. The 
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function fy(y|X = x) may be thought of as a function of the variable y, 
with the variable x arbitrary, but fixed. Accordingly, it satisfies all the 
- requirements of an ordinary probability density function, as shown by 


fr(y|X = x) 20 (8.43) 


and 


[fix = 9) dy = 1 (8.44) 


If the random variables X and Y are statistically independent, then knowl- 
edge of the outcome of X can in no way affect the distribution of Y. The 
result is that the condition probability density function fy(y |X = x) 
reduces to the marginal density fy(y), as shown by 


fr(y|X = x) = fr(y) 


In such a case, we may express the joint probability density function of 
the random variables X and Y as the product of their respective marginal 
densities, as shown by 


fxy(x, y) = fx(x)fr(y) (8.45) 


This relation holds only when the random variables X and Y are statistically 
independent. 


STATISTICAL AVERAGES 


Having discussed probability and some of its ramifications, we now seek 
ways for determining the average behavior of the outcomes arising in ran- 
dom experiments. 

The mean or expected value of a random variable X is commonly defined 
by 


my = E[X] = | ” xf x(x) dx (8.46) 


where E denotes the expectation operator. That is, the mean my locates 
the center of gravity of the area under the probability density curve of the 
random variable X. Similarly, the mean of a function of X, denoted by 
g(X), is defined by 


Ele(X)] = | Bf) dx (8.47) 
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For the special case of g(X) = X” we obtain the nth moment of the 
probability distribution of the random variable X; that is, 


E[X"] = |  xtfx(2) dx (8.48) 


By far the most important moments of X are the first two moments. Thus 
putting n = 1in Eq. 8.48 gives the mean of the random variable as discussed 
herein, whereas putting n = 2 gives the mean-square value of X: 


EPEE Í " x fa(x) dx (8.49) 


We may also define central moments, which are simply the moments of 
the difference between a random variable X and its mean my. Thus the 
nth central moment is 


E[(X - mx)"] = ee (x — mx)"fx(x) dx (8.50) 


For n = 1, the central moment is, of course, zero, whereas for n = 2 the 
second central moment is referred to as the variance of the random variable: 


Var[X] = E(X - m,)’] = Í ” (x = mx}fx(x)dx (8.51) 


The variance of a random variable X is commonly denoted as o%. The 
square root of the variance, namely, oy, is called the standard deviation 
of the random variable X. 

The variance o% of a random variable X is in some sense a measure of 
the variable’s “dispersion.” By specifying the variance 0%, we essentially 
constrain the effective width of the probability density function fy(x) of 
the random variable X about the mean my. A precise statement of this 
constraint was developed by Chebyshev. The Chebyshev inequality states 
that for any positive number €, we have 


2 
P(|X - mx| = 2) <> (8.52) 


From this inequality we see that the mean and variance of a random variable 
give a partial description of its probability distribution. 

The expectation operator is linear in that the expectation of the sum of 
two random variables is equal to the sum of their individual expectations. 
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Hence, expanding E[(X — my,)’] and using the linearity of the expectation 
operator, we find that the variance o% and the mean-square value E[X?] 
are related by 


E[X?] — 2myE[X] + mi 
EX = mi (8.53) 


9 
> 
Hi 


Therefore, if the mean my is zero, then the variance o4 and the mean- 
square value E[X?] of the random variable X are equal. 

Another important statistical average is the characteristic function $x(v) 
of the probability distribution of the random variable X, which is defined 
as the expectation of exp(juX), as shown by 


$x(v) = Efexp(jvX)] 
Í * fee) exp(jox) dx (8.54) 


l 


where v is real. In other words, the characteristic function ġ x(v) is (except 
for a sign change in the exponent) the Fourier transform of the probability 
density function f(x). In this relation we have used exp( jvx) rather than 
exp(—jux), so as to conform with the convention adopted in probability 
theory. Recognizing that v and x play analogous roles to the variables 27 f 
and ¢ of Fourier transforms, respectively, we deduce the following inverse 
relation from analogy with the inverse Fourier transform: 


fale) = zy [7 x(v) exp(—jox) do (8.55) 


This relation may be used to evaluate the probability density function f x(x) 
of the random variable X from its characteristic function ¢y(v). 


EXERCISE 5 Given the Chebyshev inequality of Eq. 8.52, what is the 
- probability P(|X — m x| < €)? i i 
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EXAMPLE 4 UNIFORM DISTRIBUTION (CONTINUED) 


Consider again the uniformly distributed random variable X, described in 
Example 3. We wish to evaluate the mean and variance of X. 
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The probability density function of the random variable X is given in 
Eq. 8.35. Therefore, substituting Eq. 8.35 in Eq. 8.46, we get the mean 
of X as 


b° Xx 
my = | dx 
a 


b-a 
7 b? — a? 
2b a) 
=5(b +a) (8.56) 


Thus the mean of a uniformly distributed random variable is the arithmetic 
mean of its limits a and b, which is intuitively satisfying. The mean-square 
value of the random variable X is obtained by substituting Eq. 8.35 in 8.49; 
we thus get 


x 


Be 
mae 


b? — æ 
— 3(b — a) 
1 2 2 
ed ie ee) (8.57) 


Hence, the use of Eq. 8.53 yields the variance of the random variable X 
as 


o% = 5 (b? + ab + a?) -Eb + ay 


= (b-a) (8.58) 


As an application of these results, we may consider the quantizing error 
in pulse-code modulation. Assuming that the quantizing error is uniformly 
distributed inside the interval (—34, 24), we find from Eq. 8.56 that it 
has zero mean. Moreover, from Eqs. 8.57 and 8.58, we find that the mean- 
Square value and the variance of the quantizing error are both equal to 
A’/12. These results are the same as those we used in discussing quantizing 
error in Section 5.4. 
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EXAMPLE 5 SUM OF INDEPENDENT RANDOM VARIABLES 


As an application of the characteristic function, consider the problem of 
evaluating the probability density function of a random variable Z defined 
as the sum of two statistically independent random variables X and Y, that 
is, Z = X + Y. The characteristic function of Z is 


oz(v) = ElexpGu(X + Y))] 
= E[exp(jvX) - exp(jvY)] (8.59) 


Since X and Y are statistically independent, we may express @;(v) as 
oz(v) = Elexp(jvX)] - Elexp(jvY )] 
bx(v)y(v) (8.60) 


By analogy with the result in Fourier analysis, that the convolution of two 
functions of time corresponds to the multiplication of their Fourier trans- 
forms, we deduce that the probability density function of the random 
variable Z = X + Y is given by the convolution of the probability density 
functions of X and Y, as shown by 


fo(z) = | fe — mM (8.61) 
JOINT MOMENTS 


Consider next a pair of random variables X and Y. A set of statistical 
averages of importance in this case are the joint moments, namely, the 
expected value of X/Y*, where j and k may assume any positive integer 
values. We may thus write 


ELA = F P efx, y) dx dy (8.62) 


A joint moment of particular importance is the correlation defined by 
E[XY], which corresponds to j = k = 1 in Eq. 8.62. 

The correlation of the two centered random variables X — E[X] and 
Y — E[Y], that is, the joint moment 


Cov[XY] = E[(X - E[X])(Y - E[Y))] (8.63) 


is called the covariance of X and Y. Letting my = E[X] and my = E[Y], 
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we may expand Eq. 8.63 to obtain 
Cov[ XY] = E[XY] - mymy (8.64) 


Let c% and gł, denote the variances of X and Y, respectively. Then the 
covariance of X and Y normalized with respect to axay is called the cor- 
relation coefficient of X and Y: 


Pxy = Gonz] (8.65) 


Ox0y 


We say that the two random variables X and Y are uncorrelated if and 
only if their covariance is zero, that is, if and only if 


Cov[ XY] = 0 


We say that they are orthogonal if and only if their correlation is zero, that 
is, if and only if 


E[XY] = 0 


From Eq. 8.64 we observe that if one or both of the random variables X 
and Y have zero means, and if they are orthogonal random variables, then 
they are uncorrelated, and vice versa. Note also that if X and Y are sta- 
tistically independent, then they are uncorrelated. However, the converse 
of this statement is not necessarily true, as illustrated by the following 
example. 
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EXAMPLE 6 


Let Z be a uniformly distributed random variable, defined by 


=== 


1 
a) By 
1a a otherwise 


Let the random variable X = Z and the random variable Y = Z?. It is 
apparent that X and Y are not statistically independent because Y = X?. 
We wish to show, however, that X and Y are uncorrelated. 

Since X = Z, the mean of X is 


E[X] = E[Z] = =zdz= 


eececcococcooececsoooscoccecscsecoocoooooocoocoocscosocovoecoccoooooooooooooe 
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Also, since Y = Z?, the mean of Y is 


Bri Ezi- f 52 dz =; 


-1 
The covariance of X and Y is therefore 


Cov[XY] = ELX(Y - 4)] 
E[XY] — 4E[X] 
= E[XY] 
= E|Z?] 


a | 
= oe) 
E: dz 


0 


Il 


Hence, the random variables X and Y are uncorrelated despite the fact 
that they are statistically dependent. 
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8.3 GAUSSIAN DISTRIBUTION 


The Gaussian random variable’ is by far the most widely encountered 
random variable in the statistical analysis of communication systems. A 
Gaussian random variable X of mean my and variance c% has the prob- 
ability density function: 


Fx(x) = exp] - = (x - mx) | (8.66) 


1 
VINO y 


The fact that Eq. 8.66 is a probability density function is easily shown. 
First, note that f(x) = 0. Second, form the integral 


2 1 . i ' 
r fx(x) dx = A I ep] - 203 * = ms) | dx (8.67) 


The Gaussian distribution is named after the great mathematician C. G. Gauss. 
At age 18, Gauss invented the method of least squares for finding the best 
estimate of a quantity based on a sequence of measurements. Gauss later 
used the method of least squares in estimating orbits of planets with noisy 
measurements, a procedure that was published in 1809 in his book Theory of 
Motion of the Heavenly Bodies. In connection with the error of observation, he 
developed the Gaussian distribution. This distribution is also known as the 
normal distribution. Partly for historical reasons, mathematicians commonly use 
normal, whereas engineers and physicists commonly use Gaussian. 


wwccccvecesenecee 
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We now make the change of variable t = (x — my)/V 20x, so Eq. 8.67 
becomes 


i hoa- i a a di = 1 (8.68) 


For the last step in Eq. 8.68, see Exercise 6 of Chapter 2. 
The distribution function of a Gaussian random variable X of mean my 
and variance g% is defined by 


F,(z) = = 5 exp| - a S mx) | dé (8.69) 


Unfortunately, this distribution function is not expressible in terms of 
elementary functions. Nevertheless, it may be evaluated for a specified 
value of x by making use of tables of the error function,* which is defined 
as 


erf(u) = == | " exp(— z?) dz (8.70) 
m J0 


Note that erf(0) = 0 and erf(~) = 1. In Table 6 of Appendix D, we present 
a short set of values for the error function erf(u) for u in the range 0 to 
3.3; 

By using the symmetry of f(x) and by a simple change of variables, 
we may express the distribution function of Eq. 8.69 in terms of the error 
function as follows: 


Fy(x) = > f + orf") | i - £8.71) 


The functions f y(x) and F(x) are plotted in Fig. 8.5 for the standardized 
case when the mean my is 0 and the variance ø% is 1. Note that (1) the 
probability density function is symmetric about the mean, (2) values of x 
near the mean are most frequently encountered, and (3) the width of the 
probability density curve is proportional to the standard deviation cy. 


‘The error function is tabulated extensively in several references; see, for 
example, Abramowitz and Stegun (1965). 


aoai J. Hermsen, FEE Department 
aoa il State Polytechnic Univ. 

ae West Tempte Avenue 

Pomona, CA 91768 
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(b) 


Figure 8.5 
Probability functions of a normalized Gaussian random variable of zero mean and 
unit variance. (a) Probability density function. (b) Distribution function. 


EXAMPLE 7 


Suppose we wish to determine the probability that the Gaussian random 
variable X lies in the interval my — kay < X < my + kay, where k isa 
constant. In terms of the probability density function of X, we may use 
the second line of Eq. 8.33 and Eq. 8.71 to express this probability as 


P(my — koy < X < my + kox) Fy(mx + kax) — Fx(mx — kax) 


COKE 


Noting that the error function erf(u) has the property that 


Cr TTTTTTTTTTTTTRTTTTIT TTT TTTTTTTTTTTTTTTTTTITTILITTITILITTTTTI 
eccococoooocosoascsecocococcosoos 


eni(—u) = erf(u), 


428 PROBABILITY THEORY AND RANDOM PROCESSES 


we get the desired result 


(8.72) 


k 
P(my — koy < X < my + koy) = erf N? 


For example, for k = 3, we find that 
P(my — 30x < X < myx + 30x) = 0.997 


That is, the probability that a Gaussian random variable X lies within +30 x 
of its mean my is very close to one. 


EXERCISE 6 The complimentary error function is defined by 
erfc(u) = —= al exp(— z?) dz 


It is related to the error function erf(u) as 
erfe(u) = 1 — erf(u) 


Show that for a specified value of u, the complementary error function 
erfc(u) equals twice the area under the tail of the curve of the probability 
density function of a Gaussian random variable whose mean is zero and 
variance is 1/2. 


EXERCISE 7 A random ae X is Gaussian distributed with mean 
my = 5 and variance a} = 64 What is the cpřobabiliy of the event 
—-3< X¥ < 13? — 


CENTRAL LIMIT THEOREM 


An important result in probability theory that is closely related to the 
Gaussian distribution is the central limit theorem.’ Let X,, X),..., X, 
be a set of random variables that satisfies the following requirements: 


1. The X,, with k = 1,2, ... , n, are statistically independent. 
2. The X, all have the same probability density function. 
3. Both the mean and variance exist for each X,. 


"For a proof of the central limit theorem, see the references listed in footnote 1. 


evoccescoese 
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Define a new random variable Y as 
ve Sy X, (8.73) 
k= 


Then, according to the central limit theorem, the standardized random 
variable: 


a= ely] 


Oy 


Z (8.74) 


approaches a Gaussian random variable with zero mean and unit variance 
as the number of the random variables X,, X2, . . . , X, increases without 
limit. Note that from the definitions of expectation and variance of a ran- 
dom variable, we may relate the mean and variance of Y to the corre- 
sponding moments of the X, as follows: 


Ely] = DEX] (8.75) 
and 
Var[Y] = 5 Var[X,] (8.76) 


It is important to realize that the central limit theorem gives only the 
“limiting” form of the distribution function of the standardized sum Z as 
n tends to infinity. When n is finite, it is sometimes found that the Gaussian 
limit gives a relatively poor approximation for the actual distribution func- 
tion of Z, even though n may be large. The accuracy of this approximation 
depends on the nature of the distribution of the X,. 


EXAMPLE 8 SUM OF n UNIFORMLY DISTRIBUTED RANDOM VARIABLES 


Consider the random variable 
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Figure 8.6 
Uniform distribution. 


where the X, are uniformly distributed random variables defined by (see 


Fig. 8.6) 
a eee 
fan Sana 7 ae (8.77) 
0, elsewhere 
From Example 4, we find that the mean and variance of the X, are given 
by 
myx, = 0 
a? 
PERSA 
OX, 12 (8.78) 


Therefore, according to the central limit theorem, we may use a Gaussian 
random variable of zero mean and variance na’/12 to approximate the sum 
of n independent and identically distributed (iid) random variables, assuming 
a uniform distribution and large n. 
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eosossssaceeoesoco 8.4 TRANSFORMATION OF RANDOM VARIABLES 


Consider the problem of determining the probability density function of a 
random variable Y, which is obtained by a one-to-one transformation of 
a given random variable X. The simplest possible case is when the new 
random variable Y is a monotone increasing differentiable function g of 
the random variable X (see Fig. 8.7): 


Y= 9(X) 
In this case we have 


Fy(y) = P(Y < y) 
P(X < h(y)) 
Fy(A(y)) (8.79) 
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Figure 8.7 
A one-to-one transformation of a random variable X. 


where h is the inverse transformation 


WA) e y) (8.80) 


This inverse transformation exists for all y, because x and y are related 
one-to-ọne. Assuming that the given random variable X has a probability 
density function fy(x), we may write 


h(y) 


Fy(y) = [7 RO) dx 


Differentiating both sides of this relation with respect to the variable y, 
we get 


f(y) = Fa(h(»)) F (8.81) 


Consider next the case when g is a differentiable monotone decreasing 
function with an inverse h. We may then write 


Fry) = | f0) dx 
h(y) 
which, on differentiation, yields 
dh 
fy(y) = -fx(h(y)) a (8.82) 


Since the derivative dh/ dy is negative in Eq. 8.82, whereas it is positive 
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in Eq. 8.81, we may express both results by the single formula 


fr(y) = fx(A(y)) a (8.83) 


This is the desired formula for finding the probability density function of 
a one-to-one differentiable function of a given random variable. 
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EXAMPLE 9 SQUARE-LAW TRANSFORMATION 


Consider a Gaussian random variable X of zero mean and variance o%, 
which is transformed by a square-law device defined by 


y= X? (8.84) 
as illustrated in Fig. 8.8. We wish to find the probability density function 
of the new random variable Y. 

First, we see from Fig. 8.8 that Y can never be negative. Therefore, 
P(Y<y)=0, y<0 
and so 


Fy(y)=0, y<0O 


Furthermore, we note that the inverse transformation is not single-valued, 
as shown by 


vee A) at eS (8.85) 


Figure 8.8 
: Square-law transformation. 
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Consequently, both positive and negative values of x contribute to y. Sup- 
pose that we are interested in the probability that Y = y, where y > 0. 
We may then write 


P(Y < y) = P(-Vy < X < Vy) 


P(X = Vy) — P(X < - Vy) 
vy -vy 
= [| fee) de- | Ka) a 


Differentiating both sides of this relation with respect to y, we obtain 


1 
frly) = Wy [fx(Vy) + fx(-Vy)] 


Noting that 


we obtain 


= 0 2 4 6 


; Figure 8.9 
: Probability density function of random variable Y at the output of a square-law 
3 device with a Gaussian random variable as input. 
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We thus find that the complete probability density function of the trans- 
formed random variable Y is given by 


1 y 
== OXp| Sas | > 0 
frly) = 4 V2 yen r( 20% 1 (8.86) 
, y <0 
which is plotted in Fig. 8.9. The probability density function of Eq. 8.86 
is called a chi-squared density function when it is written as a function of 
the variable xy? = y. 


8.5 RANDOM PROCESSES 


A basic concern in the statistical analysis of communication systems is the 
characterization of random signals such as voice signals, television signals, 
digital computer data, and electrical noise. These random signals have two 
properties. First, the signals are functions of time, defined on some ob- 
servation interval. Second, the signals are random in the sense that before 
conducting an experiment, it is not possible to describe exactly the wave- 
forms that will be observed. Accordingly, in describing random signals we 
find that each sample point in our sample space is a function of time. For 
example, in studying the fluctuations in the output of a transistor, we may 
assume the simultaneous testing of an indefinitely large number of identical 
transistors as a conceptual model of our problem. The output (measured 
as a function of time) of a particular transistor in the collection is then one 
sample point in our sample space. The sample space ensemble comprised 
of functions of time is called a random or stochastic’ process. As an integral 
part of this notion, we assume the existence of a probability distribution 
defined over an appropriate class of sets in the sample space, so that we 
may speak with confidence of the probability of various events. We may 
thus define a random process as an ensemble of time functions together with 
a probability rule that assigns a probability to any meaningful event asso- 
ciated with an observation of one of these functions. 

Consider a random process X(t) represented by the set of sample func- 
tions {x;(t)}, j = 1,2,..., n, as illustrated in Fig. 8.10. Sample function 
or waveform x(t), with probability of occurrence P(s,), corresponds to 
sample point s, of the sample space S, and so on for the other sample 
functions x,(t),. . . , x,(¢t). Now suppose we observe the set of waveforms 
{x;()}, j = 1, 2,..., n, simultaneously at some time instant, £ = tı, as 
shown in the figure. Since each sample point s; of the sample space S has 
associated with it a number x;(t,) and a probability P(s;), we find that the 


The word “stochastic” comes from Greek for “to aim (guess) at”. 


Cea eeacecsccseseeeeeeerveeseeseesseseoesenes 


eeeecacas POCO CCOH OOO SO OHO SESE SOO ED EEHEHOSSO OS OOOO PSSOEEETSSO ROSH SOO OOOEOOOOOOO ESOT EFOOSSSSSSTTSSOSESHEHSSOOTSSSSSOSOOOEOE 


RANDOM PROCESSES 435 


Samole 
space 


S 


x(t) 
(] 
Outcome of 
| first 
| experiment 
l 
| 
t 
l 
l 
x(t) 
i Outcome of 
| second 
| experiment 
I 
l 
| 
I 
| 
t 
I 
I 
| 
x, (t) ! 
Outcome of 
t, nth 
experiment 
t —— 
Figure 8.10 
An ensemble of sample functions. 
resulting collection of numbers {x;(¢,)}, 7 = 1, 2, . . . , n, forms a random 


variable. We denote this random variable by X(t,). By observing the given 
set of waveforms simultaneously at a second time instant, say t,, we obtain 
a different collection of numbers, hence a different random variable X(t). 
Indeed, the set of waveforms {x;(t)} defines a different random variable 
for each choice of observation instant. The difference between a random 
variable and a random process is that for a random variable the outcome 
of an experiment is mapped into a number, whereas for a random process 
the outcome is mapped into a waveform that is a function of time. 


RANDOM VECTORS OBTAINED FROM RANDOM PROCESSES 


By definition, a random process X(t) implies the existence of an infinite 
number of random variables, one for each value of time ¢ in the range 
—œ < t < œ. Thus we may speak of the distribution function Fy,,)(x;) of 
the random variable X(¢,) obtained by observing the random process X(t) 
at time ¢,. In general, for k time instants ¢,, t, ... , tą we define the k 
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random variables X(t), X(t), ..., X(t), respectively. We may then 
define the joint event 


X(t) S x1, X(t) S x2, . . . , MG) = Xz 
The probability of this joint event defines the joint distribution function: 


Fy), xa) ee x(t, (41 Xone Gk 
= P(X(t) < Xis X(t) = X2, om a X(t) < Xx) (8.87) 


For convenience of notation, we write this joint distribution function simply 
as Fx (x) where the random vector X(t) equals 


X(t) 
X(t) 


x(t) = | *¢ 
X (tx) 


and the dummy vector x equals 


For a particular sample point s,, the components of the random vector 
X(t) represent the values of the sample function x,(t) observed at times 
t,t,...,t. Note also that the joint distribution function Fx()(x) depends 
on the random process X(t) and the set of times {t;}, i = 1,2,...,k 
The joint probability density function of the random vector X(t) equals 


Fao) = 35 Gy Faw) (8.88) 


OX OX a a a 


This function is always nonnegative, with a total volume underneath its 
curve in k-dimensional space that is equal to one. 


Errr rrr rrr rrr rT TTTTTTTTTTTTTITITITTTITTTIIILLLLLITTTTTTTTTTTTTYTTTILIIITTITT] 


: Consider the probability of obtaining a sample function or waveform x(t) 
: of the random process X(t) that passes through a set of k “windows,” as 


e 
e 
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Figure 8.11 
The probability of a joint event. 


illustrated in Fig. 8.11 for the case of k = 3. That is, we wish to find the 
probability of the joint event 
A = {a; < X(t) < b;}, iat eae se 


Given the joint probability density function fx (x), this probability equals 


bi [bz by 
P(A) = Í f a. fx) dx, dx, teas dx, 


“eevee Pre rer rrr rir riiriiririiririrrirritiriiiii irri irri rity) 


POCOO . 8.6 STATIONARITY 


Consider a set of times ¢,, 6, ..., tą in the interval in which a random 
process X(t) is defined. A complete characterization of the random process 
X(t) enables us to specify the joint probability density function fx (x). 
The random process X(t) is said to be strictly stationary if the joint prob- 
ability density function fx (x) is invariant under shifts of the time origin. 
In other words, the process X(t) is strictly stationary if the equality 


f x(t)(X) = f X(t+ 7)(x) (8.89) 


holds for every finite set of time instants {t;}, i = 1, 2,...,k, and for 
every time-shift T. The components of the random vector X(t) are obtained 
by observing the random process X(f) at times 4, t2, . . . , t,. Correspond- 
ingly, the components of the random vector X(t + T) are obtained by 
observing the random process X(t) at times ti + T, + T,...,% +T, 
where T is a time shift. 
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la E 


(a) 


(b) 


Figure 8.12 
The concept of stationarity. 


Stationary processes are of great importance for at least two reasons: 


1. They are frequently encountered in practice or approximated to a high 
degree of accuracy. It is not necessary that a random process be sta- 
tionary for all time, but only for some observation interval that is long 
enough for the particular situation of interest. 

2. Many of the important properties of commonly encountered stationary 
processes are described by first and second moments. Consequently, it 
is relatively easy to develop a simple but useful theory to describe these 
processes. 


Random processes that are not stationary are called nonstationary. 


aT TTTTTTTTTT TTT TTTTTTTTTTTTITTTTTTTTTTTTTTTTITTTTETTTTTTTT 


EXAMPLE 11 


Suppose we have a random process X(t) that is known to be strictly sta- 
tionary. An implication of stationarity is that the probability that a set of 
sample functions of this process pass through the windows of Fig. 8.12a is 
equal to the probability that a set of the same number of sample functions 
pass through the corresponding time-shifted windows of Fig. 8.12b. Note, 
however, that it is not necessary that these two sets consist of the same 
sample functions. 
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8.7 MEAN, CORRELATION, AND COVARIANCE FUNCTIONS 


In many practical situations we find that it is not possible to determine (by 
means of suitable measurements, say) the probability distribution of a 
random process. Then we must content outselves with a partial description 
of the distribution of the process. Ordinarily, the mean, autocorrelation 
function, and autocovariance function of the random process are taken to 
give a crude but, nevertheless, useful description of the distribution; these 
terms are defined in the following paragraphs. 

Consider a random process X(t) assumed to be strictly stationary. Let 
X(t,) denote the random variable obtained by observing the process X(t) 
at time ¢,. The mean of the process X(t) is a constant, defined by 


my = E[X(t,)] for any t, 


where E denotes the expectation operator. We may simplify the notation 
by writing 


my = E[X(t)] (8.90) 


where X(t) is treated as a random variable for a fixed value of t. 
The autocorrelation function of a stationary process X(t) is defined as 


Rx(t, — t) = E[X (t) X(t;)] for any t, and t; 


where X(t,) and X(t;) are the random variables obtained by observing the 
process X(t) at times t, and t;, respectively. Note that the autocorrelation 
function depends only on the time difference ¢, — t;. We may simplify the 
notation by using the variable t to denote the time difference ¢, — t; and 
redefining the autocorrelation function of the process X(t) as 


Rx(t) = E[X(H) X(t — 7) (8.91) 


where insofar as the expectation is concerned, X(t) and X(t — qt) are 
treated as random variables. The variable t is commonly referred to as a 
time lag or time delay; the terms are used interchangeably. Equation 8.91 
shows that for a stationary process, the autocorrelation function Ry(t) 
is independent of a shift of the time origin. Note also that the argu- 
ment of R(t) is obtained by subtracting the argument of the second factor 
X(t — t) from that of the first factor X(t). 

Yet another characteristic of a stationary process X(t) is the auto- 
covariance function defined by 


Kx(t — ti) = El(X(t) — mx)(X(t) — mx)| for any t, and ¢, 


i 
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As with the autocorrelation function, we may simplify the notation by 
redefining the autocovariance function of the process X(t) as 


Ky(t) = E[(X(t) — mx)(X(t- 1) - mx)] (8.92) 


It is a straightforward matter to show that the autocovariance function 
K,(t), the autocorrelation function Ry(t), and the mean my of a stationary 
process X(t) are related as follows 


_Ky(t) = Rx(t) — my (8.93) 


Clearly, if the process X(t) has zero mean (i.e., my is zero), then the 

autocovariance and autocorrelation functions of the process are the same. 
From here on we will use the mean and autocorrelation function as a 

partial description of a random process. Moreover, we assume that 


1. The mean of the process is constant. 


2. The autocorrelation function of the process is independent of a shift of 
the time origin. 


3. The autocorrelation function at a lag of zero is finite. 


These three conditions, however, are not sufficient to guarantee that the 
random process in question is strictly stationary. A random process that 
is not strictly stationary but for which these conditions hold is said to be 
wide-sense stationary (WSS). Naturally, all strictly stationary processes are 
wide-sense stationary, but the converse is not necessarily true. 


PROPERTIES OF THE AUTOCORRELATION FUNCTION 


The autocorrelation function Ry(t) of a wide-sense stationary process X(t) 
has several important properties that follow from the definition given in 
Eq. 8.91. In particular, we may state: 


PROPERTY 1 


The autocorrelation function of a wide-sense stationary process is an even 
function of the time lag. 


That is to say, the autocorrelation function R(t) satisfies the symmetry 
condition: 


Rx(t) = Rx(-1) (8.94) 
For R(t), we write (see Eq. 8.91): 


Ry(t) = E[X()X(¢ — 7)] 
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Clearly, the product X(t)X(t — t) is unaffected by an interchange of the 
two terms X(t) and X(t — 1); hence, 


Rx(t) = E[X(t — 1)X(0)] 


Rx(-7) 


which is the desired result. 


PROPERTY 2 


The mean-square value of a wide-sense stationary process equals the 
autocorrelation function of the process for zero time lag. 


In mathematical terms, we may write 
Rx(0) = E[X?(9)] (8.95) 


This result follows directly from Eq. 8.91 by putting the time lag t = 0. 


PROPERTY 3 


The autocorrelation function of a wide-sense stationary process has its max- 
imum magnitude at zero time lag. 


In mathematical terms, Property 3 states that 
[Rx(z)| = Rx(0) (8.96) 


To prove this result, we first note that the mean-square value of the dif- 
ference between X(t) and X(t — t) is always nonnegative, as shown by 


E[(X() - X(t - 1)}] > 0 
Since we have 
(X() -— X(t - 1)} = X(t) - 2X(t)X(t - 1) + X?(t — 1), 
and the expectation is a linear operator, we may write 
ELX (0)] — 2E[X(OX (t — 7) T EX t- )=0 (8:97) 
We next note that for a wide-sense stationary process X(t): 


E[X*(t)] = E[X%(t — 1)] = Rx(0) 
E[X(t)X(t — t)] = Rx(7) 
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Ry (7) 


Slowly fluctuating 
random process 


Rapidly fluctuating 
random process 


Figure 8.13 
The autocorrelation functions of slowly and rapidly fluctuating random processes. 


Substituting these values in Eq. 8.97 and simplifying, we get the result 
given in Eq. 8.96. 


PHYSICAL SIGNIFICANCE OF THE AUTOCORRELATION FUNCTION 


The physical significance of the autocorrelation function Ry(t) is that it 
provides a means of describing the interdependence of two random vari- 
ables obtained by observing a random process X(t) at times t seconds 
apart. It is therefore apparent that the more rapidly the random process 
X(t) changes with time, the more rapidly will the autocorrelation function 
R,x(t) decrease from its maximum R,(0) as z increases, as illustrated in 
Fig. 8.13. This decrease may be characterized by a decorrelation time to, 
such that for t > Tọ, the magnitude of the autocorrelation function Ry(z) 
remains below some prescribed value. We may thus define the decorre- 
lation time Tọ of a wide-sense stationary process X(t) of zero mean as the 
time taken for the magnitude of the autocorrelation function Ry(t) to 
decrease to 1% of its maximum value R,(0); the choice of 1% is arbitrary. 


EXAMPLE 12 SINUSOIDAL WAVE WITH RANDOM PHASE 


Consider a sinusoidal process with random phase. The process is denoted 


by 


X(t) = A cos(2zf,t + 0) 


(8.98) 


where A and f, are constants, and the random variable @ denotes the 
phase. We assume that @ is uniformly distributed over a range of 0 to 27, 


that is, 


at 
IO = 4 2n’ 


0, elsewhere 


0<@s2n 


(8.99) 
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Figure 8.14 
Autocorrelation function of a sinusoidal wave with random phase. 


This means that the random variable @ is equally likely to have any value 
in the range 0 to 2z.. A sample function of the random process X(t) is 
given by 


x(t) = A cos(2zf,t + 0) 


where @ lies inside the interval [0, 27]. Note that for each sample function, 
0 remains constant. 
The autocorrelation function of X(t) is 


Rx(t) = E[X(t + 1)X(£)] 


E[ A’ cos(2zf,t + 2nf.t + O) cos(2zf,t + O)] 


i 


A? A? 
~ E[cos(4nf,t + 2af.t + 20)] + 5 E[cos(2zf.7)] 
Since the expectation is with respect to the random variable ©, we get 
A? pix 1 A? 
Rx(:) = > | 5 cos(anfit + 2afet + 26) d0 + Z cos(2nf.t) 
0 


The first term integrates to 0, so we get 


nN 


A 


Ry(t) = a cos(27f,t) (8.100) 


which is plotted in Fig. 8.14. We see, therefore, that the autocorrelation 
function of a sinusoidal process with random phase is another sinusoid at 
the same frequency in the “‘time-lag domain” rather than the time domain. 
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EXAMPLE 13 RANDOM BINARY WAVE 


Figure 8.15 shows the sample function x(t) of a process X(t) consisting of 
a random sequence of binary symbols 1 and 0. It is assumed that: 


1. The symbols 1 and 0 are represented by pulses of amplitude +A and 
— A volts, respectively, and duration T seconds. 

2. The pulse sequence is not synchronized so that the starting time of the 
first pulse, t4, is equally likely to lie anywhere between 0 and T seconds. 
That is, t, is the sample value of a uniformly distributed random variable 
Tz, with its probability density function defined by 


1 


fr (ta) = T 
0, elsewhere 


0<t4,5T (8.101) 


3. During any time interval (n — 1)T <t — ta < nT, where nis an integer, 
we have P(0) = P(1). That is, the two symbols 0 and 1 are equally 
likely, and the presence of a 1 or 0 in any one interval is independent 
of all other intervals. 


Since the amplitude levels — A and +A occur with equal probability, 
it follows immediately that E[X(t)] = 0, for all £, and the mean of the 
process is therefore zero. 

To find the autocorrelation function Ry(t, — t;), we have to evaluate 
E[X(t,)X(t;)], where X(t,) and X(t;) are random variables obtained by 
observing the random process X(t) at times tą and t;, respectively. 

Consider the first case when |t, — t| > T. Then the random variables 
X(t,) and X(t;) occur in different pulse intervals and are therefore inde- 
pendent. We thus have 


E[X(4)X(t)] = ELXGJIELXG)] = 0, l- a] > T 


Figure 8.15 
Sample function of random binary wave. 
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: Ry (r) 


: A? 


: =F 0 T 


: Figure 8.16 
Autocorrelation function of random binary wave. 


Consider next the case when |t, — t;| < T. In such a situation we observe 
from Fig. 8.15 that the random variables X(¢,) and X(t;) occur in the same 
pulse interval if and only if the delay t; is less than T — |t, — t;|. We thus 
obtain the conditional expectation: 


EO a Te _ ti 
E[X(t,) X(t,)|ta] = ie ose : | 


i Averaging this result over all possible values of t4, we get 


E[X(t,)X(t)] = [ EA 42 (ta) diy 


T-|y-t)| A2 
2 | = diy 


; = a (1 = E), eaa e 


We therefore conclude that the autocorrelation function of a random binary 


ecccccece 
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; wave, represented by the sample function shown in Fig. 8.15 is only a 

i function of the time difference t = tg — t;, as shown by 

: Ry@) = ( i), Ie] < T (8.102) 
i 0, || => T : 
This result is plotted in Fig. 8.16. ; 


i EXERCISE 8 What is the mean-square value of the random binary wave 
described in Example 13? Use physical arguments to justify your answer. 
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TIME AVERAGES AND ERGODICITY 


If the theory of random processes is to be useful as a method for describing 
communication systems, we have to be able to estimate from observations 
of a random process X(t) such probabilistic quantities as the mean and 
autocorrelation function of the process. For a stationary process, the mean 
is defined by 


E[X(t)] 


l Xf x(x) dx (8.103) 


= 
>x 
II 


and the autocorrelation function is defined by 


Rx(t) = E[X() X(t — 7)] 


Í i, XYfxw,xe-n(X, y) dx dy (8.104) 


To compute my and Rx(t) by ensemble averaging, as defined in Eqs. 8.103 
and 8.104, we have to average across all the sample functions of the process. 
In particular, this computation requires complete knowledge of the first- 
order and second-order joint probability density functions of the process. 
In many practical situations, however, these probability density functions 
are simply not available. Indeed, the only thing that we may usually find 
available is the recording of one sample function of the random process. 
It seems natural then to consider also time averages of individual sample 
functions of the process. 

We define the time-averaged mean of the sample function x(t) of a 
random process X(t) as 


a 
(x() = lim z [7 x dt (8.105) 


where the symbol () denotes time-averaging and 2T is the total observation 
interval. In a similar way, we may define the time-averaged autocorrelation 
function of the sample function x(t) as 


(x(t)x(t ~ 1) = lim 3 eo —t)dt (8.10) 


The two time averages (x(t)) and (x(t)x(t — t)) are random variables 
in that their values depend on which sample function of the random process 
X(t) is used in the time-averaging evaluations. On the other hand, my is 
a constant, and R(t) is an ordinary function of the variable z. 
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In general, ensemble averages and time averages are not equal except 
for a very special class of random process known as ergodic processes.’ A 
random process X(t) is said to be ergodic in the most general form if all of 
its statistical properties can be determined from a sample function repre- 
senting one possible realization of the process. We note here that it is 
necessary for a random process to be strictly stationary for it to be ergodic. 
However, the converse is not always true; that is, not all stationary pro- 
cesses are ergodic. 

Usually, we are not interested in estimating all the ensemble averages 
of a random process but rather only certain averages such as the mean and 
the autocorrelation function of the process. Accordingly, we may define 
ergodicity in a more limited sense, as next described. 


Ergodicity inthe Mean ‘The time average (1/27) fT-rx(t) dt is a random 


variable with a mean and variance of its own. For a stationary process, we 
find that its mean is equal to 


e| 7 [7 x a 


a | . E[x(t)] dt 


I d 
TA t 
my (8.107) 


il 


Therefore, this time average provides an unbiased estimate of my. An 
estimator is said to be unbiased if the expected value of the estimate is 
exactly the same as the true value of the pertinent parameter. We say that 
the random process X(t) is ergodic in the mean if 


ae 
lim E De (8.108) 


Too 


with probability one. That is, for a random process to be ergodic in the 
mean, its time-averaged and ensemble-averaged mean values must be equal 
with probability one. The necessary and sufficient condition for the ergo- 
dicity of the mean is that the variance of the estimator (1/2T) JT r x(t) dt 
approach zero as T approaches infinity. 


7The problem of determining conditions under which time averages computed from 
a sample function of a random process can be ultimately identified with 
corresponding ensemble averages first arose in statistical mechanics. Physical 
systems possessing properties of this kind were called ergodic by L. Boltzmann in 
1887. The term “ergodic” is of Greek origin. It comes from the Greek for “work 
path,” which relates to the path of an energetic particle in a gas in the context of 
statistical mechanics (Gardner, 1987). 
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Equation 8.108 suggests that we may estimate the mean of an ergodic 
process by passing a finite record of the sample function of the process 
through an integrator. An estimate of the mean of the process is produced 
at the integrator output. 


Ergodicity in the Autocorrelation Function Consider next the time average 
(1/2T) fT-rx(t)x(t — t) dt, which is also a random variable. Its mean is 
equal to 


Ela f Oxe aA) a E = ie ince eae 


Se (8.109) 


Accordingly, this time average provides an unbiased estimate of the en- 
semble-averaged autocorrelation function Ry(t) of the random process 
X(t). We say that the random process X(t) is ergodic in the autocorrelation 
function if 


lim + E 2 t) dt = Ry(z) (8.110) 


Too 


with probability one. The necessary and sufficient condition for a stochastic 
process to be ergodic in the autocorrelation function is that the variance 
of the estimator (1/27) J7_;x(t)x(t — t) dt approach zero as T approaches 
infinity. 

To test a sample function of a stochastic process for ergodicity in the 
mean, it suffices to know the mean my and autocorrelation function R x(t) 
of the process. However, to test it for ergodicity in the autocorrelation 
function, we have to know fourth-order moments of the process. Therefore, 
except for certain simple cases, it is usually very difficult to establish if a 
random process meets the conditions for the ergodicity in both the mean 
and the autocorrelation function. Thus, in practice, we are usually forced 
to consider the physical origin of the random process, and thereby make 
a somewhat intuitive judgment as to whether it is reasonable to interchange 
time and ensemble averages. 


EXAMPLE 14 SINUSOIDAL WAVE WITH RANDOM PHASE (CONTINUED) 


Consider again the sinusoidal process X(t) defined by 


X(t) = A cos(2zf,t + 0) 
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where A and f, are constants and @ is a uniformly distributed random 
variable: 


= O0s0s2r 
: elsewhere 


The mean of this random process is 


TE f "A cos(2nf,t + 0)fo(0) do 
a = ce 0) do 
=f ae cos(2zf.t + 0) 
=) 


The autocorrelation function of the process was determined in Example 
12; the result is reproduced here for convenience 


Ry(t) = £ cos(2zf,7) 


Let x(t) denote a sample function of the process; thus 
x(t) = A cos(2zf,t + 0) 


The time-averaged mean of the process is 


(x(t)) = lim 5 n A cos(2nf,t + 0) dt 


Too 


= 0 


; The time-averaged autocorrelation function of the process is 
EA 

(x()x(t — 1)) = lim = | cos(2nf.t + 2nf.t + 0) cos(2nf.t + 6) dt 
Too aye 


; Using the trigonometric relation 


i 1 
: cos(2zf.t + 2nf.t + O)cos(2xf.t + 0) = z cos(2nf.7) 


+ 5 cos(4nf.t Fe eer) 
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and then integrating, the expression for the time-averaged autocorrelation 
function simplifies as 


A? 

(x(t)x(t — t)) = za cos(2zf,t) 

Hence, the time-averaged mean and time-averaged autocorrelation func- 
tion of the process are exactly the same as the corresponding ensemble 
averages. This random process is therefore ergodic in both the mean and 
the autocorrelation function. 


. 
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Jeceecnonoanodacaa: 8.8 RANDOM PROCESS TRANSMISSION THROUGH 
LINEAR FILTERS 


Suppose that a random process X(t) is applied as input to a linear time- 
invariant filter of impulse response h(t), producing a random process Y(t) 
at the filter output, as in Fig. 8.17. In general, it is difficult to describe the 
probability distribution of the output random process Y(t), even when the 
probability distribution of the input random process X(t) is completely 
specified for ~% < t < œ, 

In this section, we determine the mean and autocorrelation functions 
of the output random process Y(t) in terms of those of the input X(t), 
assuming that X(t) is a wide-sense stationary process. 

Consider first the mean of the output random process Y(t). By defi- 
nition, we have 


my(t) = E[Y(t)] = e| f roxa - 1) a| (8.111) 


Provided that the expectation E[X(¢)] is finite for all t, and the system is 
stable, we may interchange the order of the expectation and the integration 
with respect to t in Eq. 8.111, and so write 


my(t) = i h(c)E[X(t ~ 1)] de 


= ji " hams — t) de (8.112) 


When the input random process X(t) is wide-sense stationary, the mean 
my(t) is a constant my, so that we may simplify Eq. 8.112 as 


My j h(t) dt 


My 


— 


mxH(0) (8.113) 
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Impulse 
response 
hít) 


Output 


X(t) Y(t) 


Figure 8.17 
Transmission of a random process through a linear filter. 


where H(0) is the zero-frequency response of the system. Equation 8.113 
states that the mean of the output process of a stable linear time-invariant 
system is equal to the mean of the input process multiplied by the zero- 
frequency response of the system. 

Consider next the autocorrelation function of the output random process 
Y(t). By definition, we have 


Ry(t, u) = ELY()Y()] 


where ¢ and u denote two values of time at which the output process is 
observed. We may therefore use the convolution integral to write 


Ry(t, u) = e h(t) X(t TA T1) dt, F h(t.) X (u = T2) dra | 
(8.114) 
Here again, provided that E[ X°(t)] is finite for all t and the system is stable, 


we may interchange the order of the expectation and the integrations with 
respect to t, and t, in Eq. 8.114, obtaining 


Re(t,u) = |? diht) | deah(n2)E[X( - 1) X(u = v) 
= F dt,h(t,) L de MER a uT) (8.115) 


When the input X(t) is a wide-sense stationary process, the autocorrelation 
function of X(t) is only a function of the difference between the observation 
times t — t, and u — 1). Thus, putting t = t — u in Eq. 8.115, we may 
write 


mer n f hDARC eaa da eO 


On combining this result with that involving the mean my, we see that if 
the input to a stable linear time-invariant filter is a wide-sense stationary 
process, then the output of the filter is also a wide-sense stationary process. 
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Since Ry(0) = E[Y?(t)], it follows that the mean-square value of the 
output random process Y(t) is obtained by putting t = 0 in Eq. 8.116. 
We thus get the result: 


AGG) = [. i h(t)h(t2)Rx(t2 — 11) dt, dt, (8.117) 


which is a constant. 


8.9 POWER SPECTRAL DENSITY 


Thus far we have considered the characterization of wide-sense stationary 
processes in linear systems in the time domain. We turn next to the char- 
acterization of random processes in linear systems by using frequency- 
domain ideas. In particular, we wish to derive the frequency-domain equiv- 
alent to the result of Eq. 8.117 defining the mean-square value of the filter 
output. 

By definition, the impulse response of a linear time-invariant filter is 
equal to the inverse Fourier transform of the transfer function of the system. 
We may thus write 


h(t) = F H(f) exp(j2nft,) df (8.118) 


Substituting this expression for h(t,) in Eq. 8.117, and rearranging the 
resultant triple integration, we get 


E[Y%(s)] = u df H(f) T drh(m) Í Rate — 11) exp(j2afn) dr 
j (8.119) 
Define a new variable 
TIn- t 
Then we may rewrite Eq. 8.119 in the form 


ety) = |7 df HC) | deah(t2) explj2aft) 
x is Ry(t) exp(—j2nfr) dt (8.120) 


The middle integral on the right side in Eq. 8.120 is simply H*(f), the 
complex conjugate of the transfer function H(f) of the filter; hence, we 
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may simplify this equation as 


EYO] = f” aH f RC) exp(—j2aft) dt (8.121) 


We may further simplify Eq. 8.121 by recognizing that the last integral is 
simply the Fourier transform of the autocorrelation function R(t) of the 
input random process X(t). Let this transform be denoted by Sy(f), written 
in expanded form as 


Saar) = ie Re rege T a (8.122) 


The function Sx(f) is called the power spectral density or power spectrum 
of the wide-sense stationary process X(t). Thus substituting Eq. 8.122 in 
8.121, we obtain the desired relation 


LY) = f IHP Sx) af (8.123) 


Equation 8.123 states that the mean-square value of the output of a stable 
linear time-invariant filter in response to a wide-sense stationary input process 
is equal to the integral over all frequencies of the power spectral density of 
the input random process multiplied by the squared magnitude of the transfer 
function of the filter. This is the desired frequency-domain equivalent to 
the time-domain relation of Eq. 8.117. 


PROPERTIES OF THE POWER SPECTRAL DENSITY 


The power spectral density Sy(f) and the autocorrelation function Rx(r) 
of a wide-sense stationary process X(t) form a Fourier transform pair, as 
shown by the pair of relations: 


Sh F Rz(1) exp(-j2aft) de (8.124) 
Rx(t) = k Sx(f) exp(j2nfr) df (8.125) 


This pair of equations constitutes the Einstein-Wiener-Khintchine relations 
for wide-sense stationary processes. 

The power spectral density of a wide-sense stationary process has a 
number of important properties that follow directly from Eqs. 8.124 and 
8.125, as next described. 
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PROPERTY 1 


The zero-frequency value of the power spectral density of a wide-sense sta- 
tionary process equals the total area under the graph of the autocorrelation 
function; that is, 


0) = is Ry(t) de (8.126) 


This property follows directly from Eq. 8.124 by putting f = 0. 


PROPERTY 2 


The mean-square value of a wide-sense stationary process equals the total 
area under the graph of the power spectral density; that is, 


ELO] = |" Sx(f) df (8.127) 


This property follows directly from Eq. 8.125 by putting t = 0, and noting 
that Ry(0) = E[X?(1)]. 


PROPERTY 3 


The power spectral density of a wide-sense stationary process is always 
nonnegative; that is, 


Sx(f) = 0, for all f (8.128) 
This is a necessary and sufficient condition for the mean-square value of 


a random process (which equals the total area under the curve of the power 
spectral density of the process) to be nonnegative. 


PROPERTY 4 


The power spectral density of a wide-sense stationary process is an even 
function of the frequency; that is 


Sx(-f) = Sx(f) (8.129) 
This property is readily obtained by substituting — f for f in Eq. 8.124. 


Sx(-f) = | * R(t) exp(j2xfr) de 
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Next, substituting — zt for t, and recognizing that Ry(—t) = Ry(rt), we 
get 


Saf) = | Rela) exp(—j2xft) de = Sx(f) 


which is the desired result. 

These properties parallel those for periodic signals, which we described 
in Chapter 4. Indeed, we may use ideas similar to those described therein 
to measure the autocorrelation function and power spectral density of a 
wide-sense stationary process. 


ease 


_ EXERCISE 9 Consider the function o(f) defined by 


_ S(f) 
a = RO 


; where S(f) is the power spectral density of a random process and R (0) is 

the value of its autocorrelation function for a lag of zero (i.e., t = 0). 

` Explain why o(f) has the properties ae associated with a probability 
ee pinchon, 
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EXAMPLE 15 SINE WAVE WITH RANDOM PHASE (CONTINUED) 


: Consider the sinusoidal process X(t) = A cos(2xf,t + ©), where the phase 
: @ is a uniformly distributed random variable over the range 0 to 2x. The 
autocorrelation function of this process is given by Eq. 8.100, which is 
reproduced here for convenience: 


Coceccesvocssveceressoceseenseees 


Ry(t) = x cos(27f,t) 


Sx (f) 


2 2 
A ftf A 


mic 0 fe 


Figure 8.18 
Power spectral density of a sinusoidal process. 


sectescasosece 
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Taking the Fourier transform of both sides of this relation, we find that 
the power spectral density of the sinusoidal process X(t) is given by 


Se(f) = 4 [af - F) + AF + £0) (8.130) 


The power spectral density Sy(f) consists of a pair of delta functions 
weighted by the factor A*/4 and located at +f, as in Fig. 8.18. We note 
that the total area under a delta function is 1. Hence, the total area under 
the S,(f) of Eq. 8.130 is equal to A?/2, as expected. 


° 
C000 SOOO ESOC OOOOH OOOO EO OOOO ODO ODO OSTEO EESSSEOOT OO OSH OOLEES OSS SOTSESOSO OSSD OSODESEOSS OOD OSOSOOTOHOOO OSES TOS OTOH SSOSSOHOOOD 


EXAMPLE 16 RANDOM BINARY WAVE (CONTINUED) 


Consider again a random binary wave consisting of a sequence of 1’s and 
0’s represented by the values +A and —A, respectively. In Example 13 
we showed that the autocorrelation function of this random process (see 
Eq. 8.102) is 


z 
Rea) = 44" ( ‘ Al ee 
0, || > T 
The power spectral density of the process is therefore 


Izl 


Sx(f) = a (: = i) EXP 2ni T) dz 


Sx (f) 


sl» 
sl- 
=|= 
sin 


Figure 8.19 
Power spectral density of random binary wave. 


POWER SPECTRAL DENSITY 457 


: Using the Fourier transform of a triangular function evaluated in Example 
: 10 of Chapter 2, we obtain 


Sy(f) = A°T sinc*(fT) (8.131) 


which is plotted in Fig. 8.19. Here again, we see that the power spectral 
density is nonnegative for all f and that it is an even function of f. We 
note from exercise 7 of Chapter 2, that 


i eine CHEM = = (8.132) 


Therefore, the total area under S,(f), or the average power of the random 
binary wave is A’. 

The result of Eq. 8.131 may be generalized as follows. We note that the 
energy spectral density of a rectangular pulse g(t) of amplitude A and 
duration T is given by 


Y (f) = AT sine*(fT) (8.133) 
We may therefore rewrite Eq. 8.131 in terms of ¥,(f) as 


SxU ee S (8.134) 


Equation 8.134 states that, for a random binary wave in which binary 
symbols 1 and 0 are represented by pulses g(t) and — g(t), respectively, 
the power spectral density Sx(f) is equal to the energy spectral density 
W,(f) of the symbol shaping pulse g(t) divided by the symbol duration T. 


Peeve reer eer 


EXERCISE 10 Sketch the autocorrelation function and power spectral 
density of a random binary wave alternating between —1 and +1 V for 
the following values of pulse duration T: 


(a) T = 3s 
b) T = 1s 
(c) T = 2s 


Comment on your results. 
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EXAMPLE 17 LINEAR MAXIMAL SEQUENCES 


There exists a class of deterministic sequences known as maximum length 
sequences with many of the properties of a random binary sequence and 
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Output 
sequence 


Modulo-two 
adder 


Figure 8.20 
Linear-maximal-sequence generator. 


yet requiring simple instrumentation. A maximum-length sequence is a 
periodic binary sequence generated by a feedback shift register that has the 
longest possible period for this particular method of generation. A shift 
register of length m is a device consisting of m consecutive 2-state memory 
stages (flip-flops) regulated by a single timing clock. At each clock pulse, 
the state (represented by binary symbol 1 or 0) of each memory stage is 
shifted to the next stage down the line. To prevent the shift register from 
emptying by the end of m clock pulses, we use a logical (i.e., Boolean) 
function of the states of the m memory stages to compute a feedback term, 
and apply it to the first memory stage of the shift register. The most 
important special form of this feedback shift register is the linear case in 
which the feedback function is obtained by using modulo-two adders to 
combine the outputs of the various memory stages. This operation is il- 
lustrated in Fig. 8.20 for m = 3. Representing the states of the three 
memory stages as xı, x2, and x3, we see that in Fig. 8.20 the feedback 
function is equal to the modulo-two sum of x, and x3. A maximum length 
sequence generated by a feedback shift register using a linear feedback 
function is called a linear maximal sequence. This sequence is always 
periodic with a period defined by 


N=2" -1 (8.135) 


where m is the length of the shift register. Assuming, for example, that 
the three memory stages of the shift register shown in Fig. 8.20 are in the 
initial states 0, 0, and 1, respectively, we find that the resulting output 
sequence is 1001110, repeating with period 7. 

Representing the symbols 1 and 0 by the values +A and —A, respec- 
tively, we find that the autocorrelation function of a linear maximal se- 


"In modulo-two addition, the sum of x, and x, takes the value 1 only when x, or x;, 
but not both, takes the value 1. In other words, the carry is ignored. This operation 
is equivalent to the logical EXCLUSIVE OR. 


POPC SO SOSTOS OH HSEEESESSESOSONOOTOSOOOSSOCSES 
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quence is periodic with period NT, and that for values of time lag t lying 
in the interval —N7/2 < t < NT/2, it is defined by 


= for the remainder of the period 


(8.136) 


(a) 


S 
ee eal 0 ni 2 
T T T TE 
an 
NT 


(b) 


Figure 8.21 
Characteristics of linear maximal sequence. (a) Autocorrelation function. (b) Power 
spectral density. 
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where T is the duration for which the symbol 1 or 0 is defined. This result 
is plotted in Fig. 8.21a@ for the case of m = 3 or N = 7. 

The autocorrelation function depicted in Fig. 8.21a exhibits two char- 
acteristics: a distinct peak value and a periodic nature. These two char- 
acteristics make linear maximal sequences well-suited for use in synchro- 
nous digital communications. For example, we may use a linear maximal 
sequence as the training sequence for adaptive equalization in a data trans- 
mission system operating over an unknown channel. Specifically, we use 
a feedback shift register in the transmitter to generate a linear maximal 
sequence for probing the channel during the training mode of the system, 
and use a second feedback shift register in the receiver that is identical to 
that in the transmitter and synchronized to it. The second feedback shift 
register generates a replica of the training sequence, which is used as the 
desired response for the adaptive equalizer in the receiver; adaptive equal- 
ization was described in Section 6.8. 

Linear maximal sequences are also referred to as pseudorandom or 
pseudonoise (PN) sequences. The term “random” comes from the fact that 
they have many of the properties of a random binary sequence, specifically, 
the following:? 


1. The number of 1’s per period is always one more than the number of 
0’s. 

2. In every period, half the runs (consecutive outputs of the same kind) 
are of length one, one fourth are of length two, one eighth are of length 
three, and so on, as long as the number of runs so indicated exceeds 
one. 


3. The autocorrelation function is two-valued. 


From Fig. 8.21a, we note that the autocorrelation function of the se- 
quence consists of a constant term equal to — A?/N plus a periodic train 
of triangular pulses of amplitude A? + A?/N, pulse width 2T and period 
NT in the t-domain. Therefore, taking the Fourier transform of Eq. 8.136, 
we find that the power spectral density of a linear maximal sequence is 
given by 


Sx(f) = -£ 6(f) + £ (: 4 x) 2 sinc) ( = a 


n=-% 


Leas of Le eo n 
= 7 lf) +A ( N2 ) 3, sine (2) ( - 2) 


(8.137) 


°For further details of linear maximal sequences, see Golomb (1964), pp. 1-32. See 
also the review paper by Sarwate and Pursley (1980). 
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EXERCISE 11 Find the limiting valle of the power pedal density of 
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which is plotted in Fig. 8.21b for m = 3 or N = 7. Comparing this power 
spectral density characteristic with that of Fig. 8.19 for a random binary 
sequence, we see that they both have an envelope of the same form, 
namely, sinc’(f T), which depends only on the duration T. The funda- 
mental difference, of course, is that whereas the random binary sequence 
has a continuous spectral density characteristic, the corresponding char- 
acteristic of a linear maximal sequence consists of delta functions spaced 
1/NT hertz apart. 


the linear maximal sequence considered in Example 17 as the period of 


the sequence becomes large. Compare your result with the power spectral 


i density ofa random pinay wave e of similar characteristics. 
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EXAMPLE 18 MODULATED RANDOM PROCESS 


A situation that often arises in practice is that of mixing (i.e., multiplication) 
of a wide-sense stationary process X(t) with a sinusoidal wave denoted by 
cos(2zf,t + @), where the phase @ is a random variable that is uniformly 
distributed over the interval 0 to 2x. The addition of the random phase @ 
in this manner merely recognizes the fact that the time origin is arbitrarily 
chosen when X(t) and cos(2zf,t + ©) come from physically independent 
sources, as is usually the case. We are interested in determining the power 
spectral density of the random process Y(t) defined by 


Y(t) = X(t) cos(2zf,t + O) (8.138) 
We note that the autocorrelation of Y(t) is given by 


Ry(t) = E[Y(t + 7) ¥(2)] 
E[X(t + 1) cos(2xf,t + 2nf.t + O)X(t) cos(2zf.t + O)] 
= E[X(t + t)X(8)] 
x Elcos(2xf,t + 2nf.c + O) cos(2xf,t + @)] 
= 4Ry(t)E[cos(2xf,r) + cos(4nf.t + 2nf,t + 20)] 
= $Ry(t) cos(27f.7) 


Because the power spectral density is the Fourier transform of the auto- 
correlation function, we find that the power spectral densities of the random 
process X(t) and Y (t) are related as follows: 


Sy(f) = Sx(f — fe) + Sx(f + F) (8.139) 


° 
e 
e 
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That is, to obtain the power spectral density of the random process Y(t), 
we shift the given power spectral density Sy(f) of random process X(t) 
to the right by f., shift it to the left by f., add the two shifted power spectra, 
and divide the result by 4. 


° e 
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RELATION AMONG THE POWER SPECTRAL DENSITIES OF THE INPUT 
AND OUTPUT RANDOM PROCESSES 


Let Sy(f) denote the power spectral density of the output random process 
Y(t) obtained by passing the random process X(t) through a linear filter 
of transfer function H(f). Then, recognizing by definition that the power 
spectral density of a random process is equal to the Fourier transform of 
its autocorrelation function and substituting Eq. 8.116 for Ry(z), we obtain 


Sr(f) = |” RvC) exp(—j2afe) dr 


= F i F h(t,)h(t.)Rx(t — tı + t2) exp(—j27ft) dt, dt, dt 
(8.140) 


Lett — Tti + T2 = To, Or, equivalently, T = t) + t, — t2. Then, by making 
this substitution in Eq. 8.140, we find that Sy(f) may be expressed as the 
product of three terms: the transfer function H (f) of the filter, the complex 
conjugate of H(f), and the power spectral density Sy(f) of the input 
process X(t), as shown by 


Sy(f) = H(F)H*(f)Sx(f) (8.141) 


However, |H(f)|? = H(f)H*(f). We thus find that the relationship among 
the power spectral densities of the input and output random processes is 
simply expressed in the frequency domain by writing 


Sy(f) = |H(f)PSx(f) (8.142) 


That is, the output power spectral density equals the input power spectral 
density multiplied by the squared magnitude of the transfer function of the 
filter. By using this relation, we can determine the effect of passing a wide- 
sense stationary process through a linear time-invariant filter. 

It is of interest to note that Eq. 8.142 may also be deduced from Eq. 
8.123 simply by recognizing that the mean-square value of a wide-sense 
stationary process equals the total area under the curve of power spectral 
density of the process in accordance with Property 2 (i.e., Eq. 8.127). 
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EXERCISE 12 Consider the comb filter"? of Fig, 8.22 consisting of a delay 
line and a summing device. Evaluate the power spectral density Sy(f) of 


~ the filter output Y(t), given that the power spectral density of the filter 


input X (¢) is Sx(f).What is the approximate value of Sy(f) for small values 
of frequency f? 


X(t) Y{t) 


(a) 


|H(f)|? 
4 


Figure 8.22 
Comb filter, 


8.10 CROSS-CORRELATION FUNCTIONS 


Let X(t) and Y(t) be two jointly wide-sense stationary processes. We define 
the cross-correlation function Ry y(t) of these two processes as: 


Ryy(t) = E[X(DY(t - D] (8.143) 


The filter of Fig. 8.22 is referred to as a “comb” filter because a graph of its 
frequency response is somewhat comb-like in appearance. 
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Similarly, we define the second cross-correlation function Ryx(t) of the 
processes X(t) and Y(t) as 


Ryx(t) = ELY()X(t - 1)] (8.144) 


A cross-correlation function is not generally an even function of T, as is 
true for an autocorrelation function, nor does it have a maximum at the 
origin. However, it does obey a certain symmetry relationship: 


Ryy(t) = Ryx(-t) . (8.145) 


EXAMPLE 19 QUADRATURE-MODULATED PROCESSES 


Consider a pair of quadrature-modulated processes X,(t) and X,(t) that are 
related to a wide-sense stationary process X(t) as follows 


X,(t) = X(t) cos(2zf,t + O) (8.146) 
X(t) = X(t) sin(2xf,t + O) (8.147) 


where @ is a uniformly distributed random variable. The cross-correlation 
function of X,(t) and X,(t) is given by 


R,(t) = EIX (X(t — 7)] 
= E[X(t)X(t — 1) cos(2nf,t + O) sin(2nf,t — 2xf.c + @)] 
= E[X(t)X(t — 1)] Elcos(2zf.t + O) sinQzf.t — 2zf + O)] 
= R QEA — 2af-¢ + 20) — sin(zf.)| 
= —#Ry(t) sin(27f,1) 
(8.148) 


Note that at t = 0, we have 


R,,(0) 


E[X,(1)X(0)] 
=0 (8.149) 


This shows that the random variables X,(t) and X,(t) obtained by observing 
the quadrature-modulated processes X,(t) and X,(t) at some fixed value 
of time ¢ are orthogonal to each other. 
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EXERCISE 13 


(a) Prove the property of cross-correlation functions of a wide-sense 
stationary process described in Eq. 8.145. 

(b) Demonstrate the validity of this property for the quadrature-mod- 
ulated processes of Example 19. 


8.11 CROSS-SPECTRAL DENSITIES 


Just as the power spectral density provides a measure of the frequency 
distribution of a single random process, cross-spectral densities provide a 
measure of the frequency interrelationship between two random processes. 

We define the cross-spectral densities Syy(f) and Syx(f) of the pair of 
random processes X(t) and Y(t) to be the Fourier transforms of the re- 
spective cross-correlation functions, as shown by 


Sea) = i E Rol) exp(-j2nfoidr (8.150) 


and 


Srx(f) = |” Ryx(2) exp(—j2nfe) dr (8.151) 


The cross-correlation functions and cross-spectral densities thus form Four- 
ier transform pairs. Accordingly, we may write 


Rux(2) = | Salf) expli2xf0) df (8.152) 


and 


Ryx(t) = |" Svx(f) expli2afe) df (8.153) 


The cross-spectral densities Syy(f) and Syx(f) are not necessarily real 
functions of the frequency f. However, substituting the relationship 


Ryy(t) = Ryx(—17) 
in Eq. 8.150, we find that Syy(f) and Syx(f) are related by 


Sxr(f) = Syx(—f) = Stx(f) (8.154) 
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That is to say, the cross-spectral densities of a pair of jointly wide-sense 
stationary processes are the complex conjugate of each other. Because of 
this property, the sum of Syy(f) and Syx(f) is real. 


PITTTTITITTTITTTITTPT TTT rrr ed 


EXAMPLE 20 


Suppose that the random processes X(t) and Y(t) have zero mean, and 
they are individually stationary in the wide sense. Consider the sum random 
process 


Z(t) = X(t) + Y@) | (8.155) 


The problem is to determine the power spectral density of Z(t). 
The autocorrelation function of Z(t) is given by 


R(t, u) 


E[Z(t)Z(u)] 

E(X) + Y(@))(X@ + Y(u))] 

E[X(t)X(u)] + ELX(Y(™)) + E[Y()X(u)] + YOY) 
Ryx(t, u) + Ryy(t, u) + Ryx(t, u) + Ry(t, u) 


(8.156) 
Defining t = t — u, we may therefore write 
Rz(t) = Ry(t) ap Ryy(t) 4 Ryx(t) T Ry(t) (8.157) 


when the random processes X(t) and Y(t) are also jointly stationary in the 
wide sense. Accordingly, taking the Fourier transform of both sides of Eq. 
8.157, we get 


S2(f) = Sx(f) + Sxv(f) + Syx(f) + Sy) (8.158) 


: We thus see that the cross-spectral densities Syy(f) and Syy(f) represent 
the spectral components that must be added to the individual power spectral 
densities of a pair of correlated random processes in order to obtain the 
power spectral density of their sum. 

: When the wide-sense stationary processes X(t) and Y(t) are uncorre- 

; lated, the cross-spectral densities Syy(f) and Syy(f) are zero, so Eq. 8.158 

: reduces to 


S2(f) = Sx(f) + Sy(f) (8.159) 
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We may generalize this result by stating that when there is a multiplicity į 
of zero-mean wide-sense stationary processes that are uncorrelated with į 
each other, the power spectral density of their sum is equal to the sum of 
their individual power spectral densities. 


k ° 
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EXAMPLE 21 : 


Consider next the problem of passing two jointly wide-sense stationary : 
random processes through a pair of separate, stable, linear, time-invariant 
filters, as shown in Fig. 8.23. In particular, suppose that the random process 
: X(t) is the input to the filter of impulse response /,(t) and that the random 
? process Y(t) is the input to the filter of impulse response h,(t). Let V(t) } 
: and Z(t) denote the random processes at the respective filter outputs. The ; 


cross-correlation function of V(t) and Z(t) is therefore, : 
Ryz(t, u) = E[V(t)Z(u)] 

: = e| Í * y(t) X(t — t) dr, Í OE dr, 

= f f mph) EX - YU ~ 2) dr dr 

: = Í f hy(t)ho(%)Ryy(t — t, u = n) dt, di (8.160) 


where Ryy(t, u) is the cross-correlation function of X(t) and Y(t). Because 
the input random processes are jointly wide-sense stationary (by hypoth- : 
esis), we may put t = t — u and so rewrite Eq. 8.160 as ; 


Ryz(t) = m z h,(t,)h2(t2)Rxy(t — Tı + T2) dt, dt, (8.161) 


Figure 8.23 
A pair of separate filters. 
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Taking the Fourier transform of both sides of Eq. 8.161 and using a 
procedure similar to that which led to the development of Eq. 8.141, we 
finally get 


Svz(f) = Hi(f)Hi(f)Sxv(f) (8.162) 


where H,(f) and H,(f) are the transfer functions of the respective filters 
in Fig. 8.23 and Hž(f) is the complex conjugate of H,(f). This is the 
desired relationship between the cross-spectral density of the output proc- 
esses and that of the input processes. Equation $ 162 includes the relation 
of Eq. 8.142 as a special case. 


= . 
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8.12 GAUSSIAN PROCESS 


Up to this point in our discussion, we have presented the theory of random 
processes in general terms. In the remainder of the chapter, we consider 
this theory in the context of some important random processes that are 
commonly encountered in the study of communication systems. 

Let us suppose that we observe a random process X(t) for an interval 
that starts at time ¢ = 0 and lasts until £ = T. Suppose also that we weight 
the random process X(t) by some function g(t) and then integrate the 
product g(t)X(t) over this observation interval, thereby obtaining a random 
variable Y defined by 


Y= f " e(t)X(t) dt (8.163) 


We refer to Y as a linear functional of X(t). The distinction between a 
function and a functional should be carefully noted. For example, the sum 
Y = >, a;X;, where the a; are constants and the X; are random variables, 
is a linear function of the X;; for each observed set of values for the random 
variables X;, we have a corresponding value for the random variable Y. 
On the other hand, in Eq. 8.163 the value of the random variable Y depends 
on the course of the argument function g(t)X(t) over the observation in- 
terval 0 to T. Thus a functional is a quantity that depends on the entire 
course of one or more functions rather than on a number of discrete 
variables. In other words, the domain of a functional is a set or space of 
admissible functions rather than a region of a coordinate space. 

If in Eq. 8.163 the weighting function g(t) is such that the mean-square 
value of the random variable Y is finite, and if the random variable Y is 
a Gaussian-distributed random variable for every g(t) in this class of func- 
tions, then the process X(t) is said to be a Gaussian process. In other 
words, the process X(t) is a Gaussian process if every linear functional of 
X(t) is a Gaussian random variable. 

Naturally, when a Guassian process X(t) is sampled at time t; for ex- 
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ample, the result is a Gaussian random variable X(t;). Let m(t;) denote 
the mean of X(t;), and o?(t;) denote its variance. We may then express the 
probability density function of the sample X(¢,) as 


_ mN 
fx) = VO exp] ars a (E) l (8.164) 


A Gaussian process has two main virtues. First, the Gaussian process 
has many properties that make analytic results possible. Second, the ran- 
dom processes produced by physical phenomena are often such that a 
Gaussian model is appropriate.. The central limit theorem provides the 
mathematical justification for using a Gaussian process as a model of a 
large number of different physical phenomena in which the observed ran- 
dom variable, at a particular instant of time, is the result of a large number 
of individual random events. Furthermore, the use of a Gaussian model 
to describe such physical phenomena is usually confirmed by experiments. 
Thus the widespread occurrence of physical phenomena for which a Gaus- 
sian model is appropriate, together with the ease with which a Gaussian 
process is handled mathematically, make the Gaussian process very im- 
portant in the study of communication systems. 

Some of the important properties of a Gaussian process are as follows: 


PROPERTY 1 


If a Gaussian process X(t) is applied to a stable linear filter, then the random 
process Y(t) developed at the output of the filter is also Gaussian. 


This property is readily derived by using the definition of a Gaussian process 
based on Eq. 8.163. Consider the situation depicted in Fig. 8.17, where 
we have a linear time-invariant filter of impulse response h(t), with the 
random process X(t) as input and the random process Y(t) as output. We 
assume that X(t) is a Gaussian process. The random processes Y(t) and 
X(t) are related by the convolution integral 


Y(t) = | "ht T er (8.165) 


where 0 < t < T is the observation interval of the input X(t). We assume 
that the impulse response h(t) is such that the mean-square value of 
the output random process Y(t) is finite for all ¢ in the time interval 
0 <t< œ for which Y(t) is defined. To demonstrate that the output process 
Y(t) is Gaussian, we must show that any linear functional of it is a Gaussian 
random variable. That is, if we define the random variable 


Z= | ° gy(t)¥(t) dt 
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or, equivalently, 
Ze Í ao i eee ei (8.166) 
0 0 


then Z must be a Gaussian random variable for every function gy(t), such 
that the mean-square value of Z is finite. Interchanging the order of in- 
tegration in Eq. 8.166, we get 


T= i ” g(a) X(t) dt (8.167) 


where 


BG) = i a ~ 2) (8.168) 


Since X(t) is a Gaussian process by hypothesis, it follows from Eq. 8.167 
that Z must be a Gaussian random variable. We have thus shown that if 
the input X(t) to a linear filter is a Gaussian process, then the output Y(t) 
is also a Gaussian process. Note, however, that although our proof was 
carried out assuming a time-invariant linear filter, this property is true for 
any arbitrary stable linear system. 


PROPERTY 2 


Consider the set of random variables or samples X(t), X(t,),..., X(t,), ob- 
tained by observing a random process X(t) at times t,, t,,...,t,. If the process 
X(t) is Gaussian, then this set of random variables are jointly Gaussian for 
any n, with their n-fold joint probability density function“ being completely 
determined by specifying the set of means 


mAt) = EIX), f= 1,2,...,0n 
and the set of autocorrelation functions 
Rylt, = t) = EIXU XOA k f= 1,2,...,0 
Property 2 is frequently used as the definition of a Gaussian process. How- 


ever, this definition is more difficult to use than that based on Eq. 8.163 
for evaluating the effects of filtering on a Gaussian process. 


"For a detailed discussion of Property 2, see Davenport and Root (1958), pp. 147- 
154; Sakrison (1968) pp. 87-97. 


GAUSSIAN PROCESS 471 


PROPERTY 3 


If a Gaussian process is wide-sense stationary, then the process is also sta- 
tionary in the strict sense. 


This follows directly from Property 2. 


PROPERTY 4 


If the set of random variables X(t,), X(t,),..., X(t,), obtained by sampling a 
Gaussian process X(t) at times t,, t,,..., t, are uncorrelated, that is, 


E[(X(t,) — Mx (X(t) = Mx )] = 0, i#k 
then this set of random variables are statistically independent. 


The implication of this property is that the joint probability density function 
of the set of random variables X(t,), X(t), . . . , X(t,) can be expressed 
as the product of the probability density functions of the individual random 
variables in the set. 


8.13 NARROW-BAND RANDOM PROCESS 


The receiver of a communication system usually includes some provision 
for preprocessing the received signal. The preprocessing may take the form 
of a narrow-band filter designed to restrict noise at the receiver input to 
a band of frequencies just wide enough to accommodate the detection of 
the modulated wave in the received signal. The signal appearing at the 
output of the narrow-band filter represents the sample function of a narrow- 
band random process. In this section, we present a canonical representation 
of such a process and its statistical characteristics. 

By analogy with the canonical representation of a narrow-band signal 
(See Section 3.5), we may likewise represent a narrow-band random proc- 
ess X(t), centered at some frequency f., in the canonical form: 


X(t) = X(t) cos(2zf,t) — Xo(t) sin(2z7f.t) (8.169) 


where X(t) is the in-phase component of X(t), and X(t) is its quadrature 
component. Given the random process X(t), we may extract the in-phase 
component X/(t) and the quadrature components X Q(t), except for scaling 
factors, using the arrangement depicted in Fig. 8.24a. 

Suppose the narrow-band random process X(t) is known to have the 
following characteristics: 


1. The power spectral density Sy(f) of the process X(t) satisfies the con- 
dition: 
Si) — 0 for =f- W and |f|=f.+ W (8.170) 
This condition is illustrated in Fig. 8.25. 
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Low-pass 1 
Low-pass me eee 


X,(t) 


cos(2rf, t) 


X,(t) 


sin(27f, t) 
(a) 
X,(t) 
+ 

cos(27f, t) — X(t) 
Xgl) 

sin(27f, t) 

(b) 


Figure 8.24 
(a) Extraction of in-phase and quadrature components of a narrow-band process. (b) 
Generation of a narrow-band process from its in-phase and quadrature components. 


2. The process X(t) is Gaussian with zero mean and variance a; the zero- 
mean characteristic is a direct consequence of the fact that X(t) is 
narrow-band. 


We then find that the random processes X(t) and X(t) have the following 
properties: 


PROPERTY 1 


The in-phase component X(t) and the quadrature component X,(t) of a nar- 
row-band random process X(t) are both low-pass random processes. 


This property follows directly from the scheme of Fig. 8.24a. Both the in- 
phase component X,(t) and the quadrature component XQ(t) appear in 
Fig. 8.24a as the outputs of low-pass filters. 


PROPERTY 2 


The in-phase component X(t) and the quadrature component X,(t) of a nar- 
row-band random process X(t) have identical power spectral densities related 
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f 
a on 
12W 12W 
Figure 8.25 
Power spectrum of a narrow-band random process. 
to that of X(t) as follows: 
v _ JSAF- f) + Sdf + f), -W<f< W 
ae = T otherwise 


(8.171) 


The proof of this property also follows from Fig. 8.24a. We first recognize 
that X;(t) and X(t) may be extracted from X(t) as follows: 


1; 


The narrow-band random process X(t) is multiplied alternately by the 
sinusoidal carriers cos(27f,t) and sin(2zf,t) to generate the pair of 
quadrature-modulated processes: 
X(t) = X(t) cos(2zf,t) (8.172) 
X(t) = X(t) sin(2zf,t) (8.173) 
where we have set the phase of the two sinusoidal carriers to be zero 
for convenience of presentation. 


. The modulated process X;(t) is passed through a low-pass filter of band- 


width W, yielding 2X,(‘). 


. The modulated process X,(t) is passed through a second low-pass filter 


of bandwidth W, yielding —2Xo(t). 


Next we recognize that the power spectral density of the modulated process 
X;,(t) is related to that of the narrow-band random process X(t) as follows 
(see Example 18) 


Sx(f) = [Sef - fe) + Sef + fo] (8.174) 


The part of Sx, (f) that lies inside the passband of the low-pass filter in 
the upper path of Fig. 8.24a defines the power spectral density of 4X(¢). 
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Accordingly, we may express the power spectral density of the in-phase 
component X,(t) as in Eq. 8.171. Note that the passbands of the low-pass 
filters in Fig. 8.24a are defined by the frequency interval -W < f < W. 
We may use similar arguments to show that the power spectral density 
Sx (f) of the quadrature component X(t) is also given by Eq. 8.171. 
The use of Eq. 8.171 suggess the following procedure for finding 


Sx(f) and Sx (f): 


1. Shift the negative-frequency portion of the power spectral density Sy(f) 
of the narrow-band random process X(t) to thg right by an amount 
equal to f., yielding S;(f — fe). 

2. Shift the positive-frequency portion of the power spectral density Sx(f) 
of the narrow-band random process X(t) to the left by an amount equal 
to fe yielding Sy(f + fe). 

3. Add the shifted power spectra found in (1) and (2), thereby obtaining 
the desired Sx,(f) or Sx (f). 


PROPERTY 3 


The in-phase component Xt) and the quadrature component X,(t) have the 
same mean and variance as the narrow-band random process X(t). 


Since the narrow-band random process X(t) has zero mean, the modulated 
processes X,(t) and X,(t) (defined in Eqs. 8.172 and 8.173) must also have 
zero mean. Moreover, Fig. 8.24a reveals that X,(t) and X9(t), low-pass 
filtered versions of X,(t) and X,(t), also have zero mean. 

To prove the remaining part of Property 3, we first observe that when 
a random process has zero mean, its variance and mean-square value as- 
sume a common value. Since both X,(t) and Xo(t) have zero mean, their 
mean-square value and therefore variance equals the total area under the 
curves of their respective power spectra, as shown by 


0%, = oke = |" IKE - fe) + Self - fol af 


Il 


[oP stag + f°" seth at 


3 (8.175) 


Il 
9 
> 


where ø% is the variance of the zero-mean narrow-band process X(t). 


PROPERTY 4 


The in-phase component X(t) and the quadrature component X,(t) of the 
narrow-band random process X(t) are uncorrelated with each other. 


To prove this property, we first observe from Eqs. 8.172 and 8.173 that 
the modulated processes X\(t) and X,(t) are obtained from X(t) by the 
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use of a pair of carriers, cos(2zf,t) and sin(2zf,t), that are in-phase- 
quadrature. Hence, X,(t) and X,(t) are orthogonal to each other (see 
Example 19). Since they both have zero mean, they are also uncorrelated 
with each other. Accordingly, the in-phase component X,(t) and the quad- 
rature component X Q(t), low-pass filtered versions of X,(t) and X,(t), are 
also uncorrelated with each other. 


PROPERTY 5 


If a narrow-band random process X(t) is Gaussian, then the in-phase com- 
ponent X(t) and the quadrature component X,(t) are also Gaussian. 


This property follows directly from the definition of a Gaussian process. 
Specifically, we observe from Fig. 8.24a that both the in-phase component 
X(t) and the quadrature component Xo(t) are derived by performing linear 
operations on the narrow-band random process X(t). If therefore X(t) is 
Gaussian, then so are X,(t) and X0(t). 

These properties have an important implication. Specifically, if the nar- 
row-band random process X(t) is Gaussian, then the in-phase component 
X(t) and the quadrature component Xo(t) are uncorrelated with each other 
(Property 4) and they are both Gaussian (Property 5). Consequently, X(t) 
and X,(t) are statistically independent of each other. Let Y and Z denote 
the Gaussian random variables obtained by observing the Gaussian proc- 
esses X,(t) and X(t) at some fixed value of time t. The probability density 
functions of these two random variables with zero mean and variance ø% 
(Property 3) are 


ago T 

fy) | = (8.176) 
il z 

fz(z) = A exp{ -25) (8.177) 


With Y and Z representing statistically independent random variables, the 
joint probability density function of Y and Z is equal to the product of 
their individual probability density functions, as shown by 


fyz(y, z) = frOy)f2(2) 


expį| — 


2 2 
y — (8.178) 


— 2mo% 20% 

Another important implication of these properties is that we may con- 
struct a narrow-band Gaussian process X(t) of prescribed statistical char- 
acteristics by means of the scheme shown in Fig. 8.24b. Specifically, we 
start with low-pass Gaussian processes X(t) and XQ(t) derived from two 
independent sources. These two processes have zero mean and the same 
variance as the process X(t). The processes X,(t) and X9(t) are modulated 
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individually by a pair of sinusoidal carriers that are in phase quadrature. 
The resulting modulated processes are then added to produce the narrow- 
band Gaussian process X(t). 


EXAMPLE 22 


Consider a noise process that is both Gaussian and white; the process is 
said to be white in the sense that it has a constant power spectral density 
(see Section 4.7). A white Gaussian noise process represents the ultimate 
in “randomness” in the sense that any two of its samples are statistically 
independent. Suppose then a white Gaussian noise process of zero mean 
and power spectral density Nọ/2 is passed through an ideal narrow-band 
filter, resulting in a narrowband Gaussian process X(t) with zero mean and 
power spectral density as shown in Fig. 8.26a. The requirement is to find 


-W0 W 
(b) 


Figure 8.26 
(a) Power spectral density of a narrow-band Gaussian process. (b} Power spectral 
density of in-phase and quadrature components. 
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the statistical characteristics of the in-phase and quadrature components 
of the process X(t). 

Following the procedure described previously (see Property 2), we find 
that the power spectra of the in-phase component X,(t) and the quadrature 
component Xo(t) are as shown in Fig. 8.26b. 

From Fig. 8.26 we deduce that the processes X(t), X,(t), and Xo(t) 
have a common variance: 


o% = 2N,W 
Moreover, they all have zero mean. Hence, the probability density func- 


tions of the random variables Y and Z, obtained by observing X,(t) and 
Xo(t) at some fixed time, are: 


Dyal ane 
FrQ) = i ex S 


z? 
kO = ae l a) 
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EXERCISE 14 Find the probability density function of a random variable. 
obtained by observing the narrow-band random process X (t) of Example 
22 at some fixed time. 


_ EXERCISE 15 Continuing with Bape 22, do the following: 


(a) Find the autocorrelation function of the narrow-band random proc- 
ess X(t). 

(b) Find the autocorrelation functions of the in-phase component X,(t) 
and quadrature component X(t). 


EXERCISE 16 Consider a narrow-band random process X(t) whose power 
spectral density Sy(f) is symmetric with respect to the midband frequency 
= fe Show that, for this special case, the power spectral densities of the in- 

phase — a X(t) and quadrature component X(t) are: 


SaD = Seg) = ca a iat) 


where 2W is the bandwidth of X(t). 
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8.14 ENVELOPE AND PHASE OF NARROW-BAND RANDOM PROCESS 


As with narrow-band signals, we may also represent a narrow-band random 
process X(t) in terms of its envelope and phase components. Specifically, 
we may write 


X(t) = A(t) cos[2zf.t + O(1)] (8.180) 


where A(t) is the envelope and @(t) is the phase of X(t). These two 
components are related to the in-phase component X,(t) and quadrature 
component X Q(t) of the process X(t) as follows : 


A(t) =[X2() + XO (8.181) 
p(t) = tan 42) (8.182) 


Let R and ¥ denote the random variables obtained by observing the 
random processes A(t) and ®(t), respectively, at some fixed time. Let Y 
and Z denote the random variables obtained by observing the related 
processes X;(t) and X0(t), respectively, at the same time. The probability 
density functions of R and ¥ may be related to those of Y and Z as follows. 
The joint-probability density function of Y and Z is given by Eq. 8.178. 
Accordingly, the joint probability that the random variable Y lies between 


Figure 8.27 

Illustrating the coordinate system for representation of a narrowband random 
process: (a) In terms of in-phase and quadrature components, and (b) in terms of 
envelope and phase. 
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y and y + dy and that the random variable Z lies between z and z + dz 
(i.e., the pair of random variables Y and Z lies inside the shaded area of 
Fig. 8.27a) is given by 


3 2 zh 2 
fyz(y, z) dy dz = exp( -” = dy dz (8.183) 


Íl 
2n0% 20% 


However, from Fig. 8.27 we observe that 


y = r cosy (8.184) 


and 


II 


z = r siny (8.185) 
where r and y are sample values of the random variables R and ¥, re- 
spectively. Also, in a limiting sense, we may equate the two areas shown 
shaded in parts a and b of Fig. 8.27, and so write 


dy dz = r dr dy (8.186) 


Therefore, substituting Eqs. 8.184 through 8.186 in 8.183, we find that the 
probability that the random variables R and ¥ lie inside the shaded area 
of Fig. 8.27b is equal to 


2 


PRO P oe 


) dr dy 

That is, the joint probability density function of R and ¥ is 
ee ee a (8.187) 
a ae 2naX 20% ` 


This probability density function is independent of the angle w, which 
means that the random variables R and ¥ are statistically independent. 


We may thus express fry(r, y) as the product of fr(r) and fy(yw). In 
particular, the random variable ¥ is uniformly distributed inside the range 


0 to 2z, as shown by 


1 


fully) = 2n’ 
0, elsewhere 


< < 
ie oat (8.188) 
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Figure 8.28 
Rayleigh distribution. 


This leaves the probability density function of R as 
: exp a = 0 
eae == j 7 
fa(r) = 1%% 2 (8.189) 
elsewhere 
where o% is the variance of the original narrow-band process X(t). A 
random variable having the probability density function of Eq. 8.189 is 


said to be Rayleigh-distributed.? 
For convenience of graphical presentation, let 


v= — (8.190) 


and 
fou) = oxfe(r) (8.191) 


Then we may rewrite the Rayleigh distribution of Eq. 8.189 in the stan- 
dardized form 


U ep(- 2) v>0 
fv) = a (8.192) 


elsewhere 


12The Rayleigh distribution is named after the English physicist J. W. Strutt, Lord 
Rayleigh. 
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Equation 8.192 is plotted in Fig. 8.28. The peak value of the distribution 
fv(v) occurs at v = 1 and is equal to 0.607. Note also that, unlike the 
Gaussian distribution, the Rayleigh distribution is zero for negative values 
of v. This is because an envelope function can only assume positive values. 
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PROBLEMS 
P8.1 Probability Theory 


Problem 1 Consider a deck of 52 cae divided into 4 different suits, 
with 13 cards in each suit ranging from the two up through the ace. Assume 
that all cards are equally likely to be drawn. 


(a) Suppose that a single card is drawn from a full deck. What is the 
probability that this card is the ace of diamonds? What is the probability 
that the single card drawn is an ace of any one of the four suits? 

(b) Suppose next that two cards are drawn from a full deck. What is 
the probability that the cards drawn are an ace and a king, not necessarily 
of the same suit? 


P8.2 Random Variables 


Problem 2 Consider a random variable X that is uniformly distributed 
between the values 0 and 1 with probability 1/4, takes on the value 1 with 
probability 1/4, and is uniformly distributed between the values 1 and 2 
with probability 1/2. Determine the distribution function of the random 
variable X. 


Problem 3 Consider a random variable X defined by the double-expo- 
nential density: 


fx(x) = a exp(—5|x|) -o <y <% 


where a and b are positive constants. 


(a) Determine the relationship between a and b so that f x(x) is a prob- 
ability density function. 

(b) Determine the corresponding distribution function Fx(x). 

(c) Find the probability that the random variable X lies between 1 
and 2. 


Problem 4 A random variable R is Rayleigh distributed with its proba- 
bility density function given by 


fer) = 4b PU) wit 
0 otherwise 


482 PROBABILITY THEORY AND RANDOM PROCESSES 


(a) Determine the corresponding distribution function F,(r). 
(b) Show that the mean of R is equal to Vbz/2. 

(c) What is the mean-square value of R? 

(d) What is the variance of R? 


Problem 5 Consider a uniformly distributed random variable Z defined 


by 
es Q0<z<22 
fz(z) = 422 l 
0, otherwise 


The two random variables X and Y are related to Z by 
X = sin(Z) 
and 
Y = cos(Z) 
(a) Determine the probability density functions of X and Y. 
(b) Show that X and Y are uncorrelated random variables. 
(c) Are X and Y statistically independent? Why? 
Problem 6 A random variable Z is defined by 
Z=X+Y 


where X and Y are statistically independent. Given that 


_ Jexp(-x), 0<x<m 
Fx) G otherwise 


and 


a) 2emp(—2y), 0 
fr) = o otherwise 


determine the probability density function of Z. 


P8.3 Gaussian Distribution 
Problem 7 


(a) The characteristic function of a random variable X is denoted by 
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x(V). Show that the nth moment of X is related to ¢y(v) by 


E[X"] = (-j)" 


d” 
dv" x(V) iy 


(b) Show that the characteristic function of a Gaussian random variable 
X of mean my and variance c% is 


dx(v) = exp(jumy — 4v’c%) 


(c) Show that the nth central moment of this Gaussian random variable 
is 


1X3 xS —- lies. for n even 
eG | if for n a i 


Problem 8 A Gaussian random variable has zero mean and a standard 
deviation of 10 V. A constant voltage of 5 V is added to this random 
variable. 


(a) Determine the probability that a measurement of this composite 
signal yields a positive value. 

(b) Determine the probability that the arithmetic mean of two inde- 
pendent measurements of this signal is positive. 


Problem 9 A random variable Z is defined by 
4 
Vi OG 
i=] 


where the X; are identically distributed and statistically independent ran- 
dom variables. It is given that the probability density function of each X; 
is 


<2 ily =} s Xi = 3 
Pa Qe) = i otherwise 
(a) Determine the probability density function fz(z). 
(b) Show that f7(z) is closely approximated by a Gaussian probability 
density function with zero mean and variance 1/3, as predicted by the 
central limit theorem. 


P8.4 Transformation of Random Variables 


Problem 10 A Gaussian random variable X of zero mean and variance 
g% is transformed by a piecewise-linear rectifier characterized by the input- 
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=~ 
i} 
x 


Figure P8.1 


output relation (see Fig. P8.1): 
y= X, X>0 
RO X <0 


The probability density function of the new random variable Y is described 
by 
0, y <0 


kô(f), = () 
e Í 


Log (-3) 
V2n0x p 20%)” eee 


(a) Explain the reasons for this result. 
(b) Determine the value of the constant k by which the delta function 
6(f) is weighted. 


P8.5 Stationarity 
Problem 11 Consider a random process X(t) defined by 


X(t) = sin(2zFt) 


in which the frequency F is a random variable with the probability density 
function 


1 
fro) =4W° 
0, otherwise 


0svs W 


Show that X(t) is nonstationary. (To avoid confusion, we have used v to 
denote frequency in place of the standard symbol f.) 


Hint: Examine specific sample functions of the random process X(t) for 
the frequency v = W/4, W/2, and W, say. 
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Problem 12 Consider the sinusoidal process 
X(t) = A cos(2zf,t) 


where the frequency f, is constant and the amplitude A is uniformly dis- 
tributed: 


O<ax<l1_ 
otherwise 


fata) = fy 


Determine whether or not this process is stationary in the strict sense. 


Problem 13 A random process X(t) is defined by 
X(t) = A cos(2zf,t) 


where A is a Gaussian random variable of zero mean and variance c}. 
This random process is applied to an ideal integrator, producing an output 
Y(t) defined by 


Y(t) = iE KO 


(a) Determine the probability density function of the output Y(t) at a 
particular time ¢,. 
(b) Determine whether or not Y(t) is stationary. 


P8.7 Mean, Correlation, and Covariance Functions 


Problem 14 Prove the following two properties of the autocorrelation 
function R(t) of a random process X(t): 


(a) If X(t) contains a dc component equal to A, then Rx(z) will contain 
a constant component equal to A’. 

(b) If X(t) contains a sinusoidal component, then R x(t) will also contain 
a sinusoidal component of the same frequency. 


Problem 15 The square wave x(t) of Fig. P8.2 of constant amplitude A, 
period Tọ, and delay t4, represents the sample function of a random process 
X(t). The delay is random, described by the probability density function 


1 
F ka T? —3Ty S tg S$ 3T 
d 0 


0, otherwise 
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x(t) 


Figure P8.2 


(a) Determine the probability density function of the random variable 
X(t,) obtained by observing the random process X(t) at time f;. 

(b) Determine the mean and autocorrelation function of X(t) using 
ensemble-averaging. 

(c) Determine the mean and autocorrelation function of X(t) using 
time-averaging. 

(d) Establish whether or not X(t) is wide-sense stationary. In what sense 
is it ergodic? 


Problem 16 A binary wave consists of a random sequence of symbols 1 
and 0, similar to that described in Example 13, with one basic difference: 
symbol 1 is now represented by a pulse of amplitude A volts and symbol 
0 is represented by zero volt. All other parameters are the same as before. 
Show that for this new random binary wave X(t), the autocorrelation 


Ry-(7) 


(volts)* 


Figure P8.3 
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function is 


Rx(t) = 


Problem 17 A random process Y(t) consists of a dc component of 
V 3/2 V, a periodic component g,(f), and a random component X(t). The 
autocorrelation function of Y(t) is shown in Fig. P8.3 


(a) What is the average power of the periodic component g,(t)? 
(b) What is the average power of the random component X(t)? 


P8.8 Random Process Transmission Through Linear Filters 


Problem 18 A random telegraph signal X(t), characterized by the au- 
tocorrelation function 


Rx(t) = exp(—2y/2]) 


where v is a constant, is applied to the low-pass RC filter of Fig. P8.4. 
Determine the autocorrelation function of the random process at the filter 
output. 


Problem 19 Let X(t) be a stationary process with zero mean and auto- 
correlation function R,(t). We are required to find a linear filter with 
impulse response h(t), such that the filter output is X(t) when the input is 
white noise of zero mean and autocorrelation function (No/2) d(t). De- 
termine the condition that the impulse response A(t) must satisfy in order 
to achieve this requirement. 


Input C Output 


Figure P8.4 
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P8.9 Power Spectral Density 
Problem 20 The output of an oscillator is described by 


X(t) = A cos(27#e + @), 


where A is a constant, and F and @ are independent random variables. 
The probability density function of F is denoted by f;(v), and that of Ø is 
defined by 

u 0<@<2n 
fe(9) = 


2n’ 
0, otherwise 


Determine the power spectral density of X(t). What happens to this power 
spectrum when the frequency v assumes a constant value? (To avoid 
confusion, we have used v to denote frequency in place of the standard 
symbol f.) 


Problem 21 Continuing with the random binary wave considered in Prob- 
lem 16, show that the power spectral density of the wave equals 


Sof) = FO) + 3 sine(s7) 


What is the percentage power contained in the dc component of the binary 
wave? 


Problem 22 Given that a stationary random process X(t) has an auto- 
correlation function Rx(t) and a power spectral density Sy(f), show that: 


(a) The autocorrelation function of dX(t)/dt, the first derivative of X(t), 
is equal to minus the second derivative of Ry(z). 


SxIf) 


—5fo —3fo —fo 0 fo 3fo 5fo 


Figure P8.5 


PROBLEMS 489 


Sx(f) 


Figure P8.6 


(b) The power spectral density of dX(t)/dt is equal to 4n7f?S,(f). 


Problem 23 Consider a wide-sense stationary process X(t) having the 
power spectral density Sy(f) shown in Fig. P8.5. Find the autocorrelation 
function Ry(t) of the process X(t). 


Problem 24 The power spectral density of a random process X(t) is shown 
in Fig. P8.6. 


(a) Determine and sketch the autocorrelation function Ry(t) of X(t). 
(b) What is the dc power contained in X(t)? 

(c) What is the ac power contained in X(t)? 

(d) What sampling rates will give uncorrelated samples of X(t)? Are 
the samples statistically independent? 


P8.10 Cross-Correlation Functions 


Problem 25 Consider two linear filters connected in cascade as in Fig. 
P8.7. Let X(t) be a wide-sense stationary process with autocorrelation 
function Ry(t). The random process appearing at the first filter output is 
V(t) and that at the second filter output is Y(t). 


(a) Find the autocorrelation function of Y(t). 
(b) Find the cross-correlation function Ryy(t) of V(t) and Y(t). 


co ae fe om 


Figure P8.7 
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Problem 26 A wide-sense stationary process X(t) is applied to a linear 
time-invariant filter of impulse response h(t), producing an output Y(¢). 


(a) Show that the cross-correlation function Ryy(t) of the output Y(t) 
and input X(t) is equal to the impulse response h(t) convolved with the 
autocorrelation function Ry(t) of the input, as shown by 


eae i WR: aye 
(b) Show that the second cross-correlation function Ryy(t) is 
Ryxy(t) = if h(—u)Rx(t — u) du 


(c) Assuming that X(t) is a white noise process with zero mean and 
power spectral density No/2, show that 


Ryx(t) = > h(t) 


Comment on the practical significance of this result. 


P8.11 Cross-Spectral Densities 


Problem 27 Let Syy(f) and Syx(f) denote the cross-spectral densities of 
two wide-sense stationary processes X(t) and Y(t). Show that Syy(f) and 
Syx(f) are related to each other as in Eq. 8.154. 


P8.12 Gaussian Processes 


Problem 28 A stationary, Gaussian process X(t) with zero mean and 
power spectral density S;(f) is applied to a linear filter whose impulse 
response A(t) is shown in Fig. P8.8. A sample Y is taken of the random 
process at the filter output at time T. 


(a) Determine the mean and variance of Y. 


(b) What is the probability density function of Y? 


A(t) 


Figure P8.8 
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Figure P8.9 


Problem 29 Continuing with the situation described in Problem 28, de- 
termine the autocorrelation function and power spectral density of the 
Gaussian process produced at the filter output. 


P8.13 Narrow-band Random Process 


Problem 30 The power spectral density of a narrow-band random process 
X(t) is as shown in Fig. P8.9. Find the power spectral densities of the in- 
phase and quadrature components of X(t), assuming that f. = 5 kHz. 


Problem 31 Assume that the narrow-band random process X(t) de- 
scribed in Problem 30 is Gaussian with zero mean and variance a%. 


(a) Calculate c}. 

(b) Determine the joint probability density function of the random vari- 
ables Y and Z obtained by observing the in-phase and quadrature com- 
ponents of X(t) at some fixed time. 


P8.14 Envelope and Phase of Narrow-band Random Process 


Problem 32 Consider a narrow-band Gaussian process X(t) with zero 
mean and power spectral density Sy(f) as shown in Fig. 8.26a. 


(a) Find the probability density function of the envelope of X(t). 
(b) What are the mean and variance of this envelope? 


Problem 33 Continuing with Problem 32, find the probability of the event 
R =A,, where R is the random variable obtained by observing the envelope 
of the narrow-band process X(t) at some fixed time, and A, is a prescribed 
positive constant. Plot this probability as a function of the ratio 

Az 
4WNo 
where W and N, are defined in Fig. 8.26a. 


p= 
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The term “noise” is shorthand for random fluctuations of power in 
electrical systems. As such, noise is the limiting factor on the power re- 
quired to transport information-bearing signals practically over all com- 
munication channels. To develop an understanding of this basic issue, 
we need to examine how noise affects the demodulation process in- 
tended to recover some message signal in a receiver. Another matter of 
related interest is the comparison of the noise performances of different 
modulation—demodulation schemes. In this chapter, we study the noise 
performance of analog (continuous-wave) modulation schemes. We de- 
fer discussion of the noise performance of digital modulation schemes until 
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Chapter 10, since its theoretical development follows a different approach. 

To undertake an introductory treatment of the noise performance of 
analog communication receivers, we may assume that the channel noise or 
front-end receiver noise is white. This simplifying assumption not only is 
justified on physical grounds, but it also enables us to obtain a basic un- 
derstanding of the way in which noise affects the performance of different 
receivers. We begin the study by describing signal-to-noise ratios that pro- 
vide the basis for evaluating the noise performance of an analog commun- 
ication receiver. 


.9.1 SIGNAL-TO-NOISE RATIOS 


To carry out the noise analysis of analog modulation systems, we obviously 
need a criterion that describes in a meaningful way the noise performance 
of the system under study. In the case of analog modulation systems, the 
customary practice is to use the output signal-to-noise ratio as an intuitive 
measure for describing the fidelity with which the demodulation process 
in the receiver recovers the original message from the received modulated 
signal in the presence of noise. Output signal-to-noise ratio is defined as 
the ratio of the average power of the message signal to the average power 
of the noise, both measured at the receiver output. Let (SNR)o denote the 
output signal-to-noise ratio, expressed as 


average power of message signal at the receiver output 


average power of noise at the receiver output 


(9.1) 


The output signal-to-noise ratio is unambiguous as long as the recovered 
message and noise at the demodulator output are additive. This require- 
ment is satisfied exactly in the case of linear receivers using coherent de- 
tection, and approximately in the case of nonlinear receivers (e.g., using 
envelope detection or frequency discrimination) provided that the average 
input noise power is small compared with the average carrier power. 

The calculation of the output signal-to-noise ratio (SNR)o involves the 
use of an idealized receiver model, the details of which naturally depend 
on the channel noise and the type of demodulation used in the receiver. 
We will have more to say on these issues in subsequent sections of the 
Chapter. For the present, we wish to point out that knowledge of (SNR)o 
by itself may be insufficient, particularly when we have to compare the 
output signal-to-noise ratios of different analog modulation-demodulation 
systems. In order to make such a comparison meaningful, we introduce 
the idea of a baseband transmission model, as depicted in Fig. 9.1. In this 
model, two assumptions are made: 


1. The transmitted or modulated message signal power is fixed. 


2. The baseband low-pass filter passes the message signal, and rejects out- 
of-band noise. 
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Low-pass filter 
of bandwidth 


Message signal with 


the same power as the equal to Output 
modulated wave the message 
bandwidth 


Channel noise 


Figure 9.1 
The baseband transmission of a message signal for calculating the channel signal- 
to-noise ratio. 


Accordingly, we may define the channel signal-to-noise ratio, referred to 
the receiver input as 


average power of the modulated message signal 


average power of noise measured in the message bandwidth 
(9.2) 


(SNR)c = 


This ratio is independent of the type of modulation or demodulation used. 

The channel signal-to-noise ratio of Eq. 9.2 may be viewed as a frame 
of reference for comparing different modulation systems. Specifically, we 
may normalize the noise performance of a specific modulation-demodu- 
lation system by dividing the output signal-to-noise ratio of the system by 
the channel signal-to-noise ratio. We may thus define a figure of merit for 
the system as 


(SNR )o 


(SNR). (9.3) 


Figure of merit = 


Clearly, the higher the value that the figure of merit has, the better the 
noise performance of the receiver. 


9.2 AM RECEIVER MODEL 


It is customary to model channel noise as a sample function of a white 
noise process! whose mean is zero and whose power spectral density is 
constant. We will denote the channel noise by w(t), and denote its power 
spectral density by N,/2 defined for both positive and negative frequencies. 
In other words, N, is the average noise power per unit bandwidth measured 
at the front end of the receiver. 


‘To be complete, the channel noise process is usually modeled as white and 
Gaussian. The Gaussian assumption relates to the probability distribution of a 
sample (random variable) drawn from the process. The Gaussian assumption does 
not enter the calculation of average noise power; hence, we do not need to involve 
it in this chapter, except for a situation described in Section 9.4 dealing with the so- 
called threshold phenomenon in amplitude modulation. 
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The received signal consists of an amplitude modulated signal component 
s(t) corrupted by the channel noise w(t). In order to limit the degrading 
effect of the noise component w(t) on the signal component s(t), we may 
pass the received signal through a band-pass filter whose bandwidth is just 
large enough to accommodate s(t). In an AM receiver of the superhetro- 
dyne type, this filtering is performed in two sections of the receiver: a radio 
frequency (RF) section and an intermediate frequency (IF) section; for a 
description of an AM receiver, see Section 7.9. Figure 9.2a depicts an 
idealized receiver model for amplitude modulation. The JF filter shown in 
this model accounts for the combination of two effects: (1) the filtering 
effect of the actual IF section in the superhetrodyne AM receiver, and (2) 
the filtering effect of the actual RF section in the receiver translated down 
to the IF band. Typically, however, the IF section provides most of the 
amplification and selectivity in the receiver. 

The IF filter has a bandwidth that is just wide enough to accommodate 
the bandwidth of the modulated signal s(t). The IF filter is usually tuned 
so that its midband frequency is the same as the carrier frequency of the 
modulated signal s(t). An exception to this is the single-sideband modu- 
lated wave, as will be explained later. For convenience in signal-to-noise 
analysis, we assume that the IF filter in the model of Fig. 9.2a has an ideal 
band-pass characteristic, as shown in Fig. 9.2b, where f, is the midband 
frequency of the filter, and B refers to the transmission bandwidth of the 
modulated signal s(t). 

The composite signal x(t), at the IF filter output, is defined by 


x(t) = s(t) + n(t) (9.4) 


Output 
signal 


IF 
filter 


Demodulator 


(a) 


Hig (f) 


=a 


(b) 


Figure 9.2 
Modeling of an AM receiver. (a) Model. (b) Idealized characteristic of IF filter. 
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where n(t) is a band-limited version of the white noise w(t). In particular, 
n(t) is the sample function of a noise process N(t) with the following power 
spectral density: 


No B B 
7A? foe el fo ee 

Swf) = 4 2 2 i (9.5) 
0, otherwise 


The band-limited noise n(t) may be regarded as being narrow-band, be- 
cause the IF filter has a bandwidth that is usually small compared with its 
midband frequency. j 

The modulated wave s(t) consists of a band-pass signal, the exact de- 
scription of which depends on the type of modulation used. To perform a 
noise analysis of the receiver, we need a corresponding representation for 
the narrow-band noise n(t). From the theory presented in Sections 8.13 
and 8.14 on narrow-band random processes, we have two methods for the 
time representation of n(t). In the first method, the narrow-band noise 
n(t) is represented in terms of its in-phase and quadrature components. 
This method is well-suited for the noise analysis of AM receivers using 
coherent detection; it may also be used for AM receivers using envelope 
detection provided that the received signal-to-noise ratio is high enough. 
In the second method, the narrow-band noise n(t) is represented in terms 
of its envelope and phase; this method is well-suited for the noise analysis 
of FM receivers. 
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We begin the noise analysis by evaluating the output and channel signal- 
to-noise ratios for an AM receiver using coherent detection, with an in- 
coming DSBSC- or SSB-modulated wave. The use of coherent detection 
requires multiplication of the IF filter output x(t) by a locally generated 
sinusoidal wave cos(2zf,t) and then low-pass filtering the product, as in 
Fig. 9.3. For convenience, we assume that the amplitude of the locally 
generated sinusoidal wave is unity. For this demodulation scheme to op- 
erate satisfactorily, however, it is necessary that the local oscillator be 
synchronized both in phase and frequency with the oscillator generating 
the carrier wave in the transmitter. We assume that this synchronization 
has been achieved. 

We show presently that coherent detection has the unique feature that 
for any input signal-to-noise ratio, an output strictly proportional to the 
original message signal is always present. It is this property of coherent 
detection, namely, that the output message component is unmutilated and 
the noise component always appears additively with the message irrespec- 
tive of the input signal-to-noise ratio, that distinguishes coherent detection 
from all other demodulation techniques. 
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Low-pass 
filter 


Product 
modulator 


IF 
filter 


s(t) y(t) 


cos (27f,.t) 


Local 
oscillator 


Figure 9.3 
Model of DSBSC receiver using coherent detection. 


DSBSC RECEIVER 
Consider a DSBSC wave defined by 


s(t) = A, cos(2nf,t)m(t) (9.6) 


where A, cos(2zf,t) is the carrier wave and m(t) is the message signal. 
Typically, the carrier frequency f, is greater than the message bandwidth 
W. Accordingly, we find that the average power of the DSBSC modulated 
wave s(t) equals A2P/2, where A, is the carrier amplitude and P is the 
average power of the message signal m(t). This result follows directly from 
the description of a modulated process as in Eq. 9.6. We also note that 
the transmission bandwidth B of the DSBSC modulated wave s(t) equals 
twice the message bandwidth W. 

With a noise power spectral density of No/2, defined for both positive 
and negative frequencies, the average noise power in the message band- 
width W is equal to WNp. The channel signal-to-noise ratio of the system 
is therefore 


(9.7) 


Next, we determine the output signal-to-noise ratio of the system. Using 
the narrow-band representation of the filtered noise n(t), the total signal 
at the coherent detector input may be expressed as: 


x(t) 


s(t) + n(t) 
A, cos(2nf,t)m(t) + ni(t) cos(2nf.t) — no(t) sin(2zf,t) (9.8) 


where n,(t) and no(t) are the in-phase and quadrature components of 
n(t), with respect to the carrier cos(2zf,t), respectively. The output of the 
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product-modulator component of the coherent detector is therefore 
v(t) = x(t) cos(2zf,t) 
= $A,m(t) + 3n,t) + 4[A.m(t) + n,(t)] cos(4zf,t) 
— 3A.no(t) sin(4zf,t) (9.9) 


The low-pass filter in the coherent detector removes the high-frequency 
components of v(t), yielding a receiver output 


y(t) = zA.m(t) + 3n,(t) (9.10) 
Equation 9.10 indicates that 


1. The message m(t) and in-phase noise component n,(t) of the narrow- 
band noise n(t) appear additively at the receiver output. 

2. The quadrature component no(t) of the noise n(t) is completely rejected 
by the coherent detector. 


w OW f 
(b) 


Figure 9.4. Le 

Noise analysis of DSBSC modulation system using coherent detection. (a) Power 
spectral density of narrow-band noise nlt) at IF filter output. (b) Power spectral 
density of in-phase components nt) and quadrature component nalt) of noise nit). 
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The message signal component at the receiver output equals A,m(t)/2. 
Hence, the average power of message signal at the receiver output is equal 
to A2P/4, where P is the average power of the original message signal 
m(t). 

The noise component at the receiver output equals ,(t)/2. Hence, the 
power spectral density of the output noise equals one quarter that of 1,(t). 
To calculate the average power of the noise at the receiver output, we first 
determine the power spectral density of the in-phase noise component n;(¢). 
In order to accommodate the upper and lower sidebands of the modulated 
wave s(t), the IF filter has a bandwidth B equal to 2W, twice the message 
bandwidth. The power spectral density Sy(f) of the narrow-band noise 
n(t) thus takes on the ideal form shown in Fig. 9.4a. Hence, the power 
spectral density of n,(t) is as shown in Fig. 9.4b (see Example 22 of Chapter 
8). Evaluating the area under the curve of power spctral density of Fig. 
9.4b and multiplying the result by 4, we find that the average noise power 
at the receiver output equals WN,/2. 

Thus dividing the average power of the message signal by the average 
power of the noise at the receiver output, we find that the output signal- 
to-noise ratio for DSBSC modulation is given by 


A? P 
NR = —— : 
(SNR )o,pse WN, (9.11) 
Next, using Eqs. 9.7 and 9.11, we obtain the figure of merit 
(SNR)o 
= 9.12 
(SNR)c | ose Oar 


_ EXERCISE 1 onside A 9.8 that coe the signal O at the detector 
- input of a coherent DSBSC receiver. Show that: 


(a) The average power of the DSBSC modulated signal component s(t) 
is A2P/2. 

(b) The average power of the filtered noise component n(t) is eel 

ey: The signal-to- -noise ratio at the detector input is => 


A2P 
R AC 
(SN. )ipsp 4WN, 
- (d) The input and output signal-to-noise ratios of the detector are re- 


lated by 
4 k 
(SNR); pss = 5 (SNR )o, psa 


Give physical reasons for this result. 
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SSB RECEIVER 


Consider next the case of a coherent receiver with an incoming SSB wave. 
We assume that only the lower sideband is transmitted, so that we may 
express the modulated wave as 


s(t) = cos(2zf.t)m(t) + 2 sin(2nf.t) M(t) (9.13) 


where r(t) is the Hilbert transform of the message signal m(t). We may 
make the following observations concerning the in-phase and quadrature 
components of s(t) in Eq. 9.13: 


1. The two components m(t) and m(t) are uncorrelated with each other. 
Therefore, their power spectral densities are additive. 

2. The Hilbert transform (t) is obtained by passing m(t) through a linear 
filter with transfer function —j sgn(f). The squared magnitude of this 
transfer function is equal to one for all f. Accordingly, m(t) and A(t) 
have the same average power. 


Thus, proceeding in a manner similar to that for the DSBSC receiver, we 
find that the in-phase and quadrature components of the SSB modulated 
wave s(t) contribute an average power of A?P/8 each. The average power 
of s(t) is therefore A2P/4. This result is half that in the DSBSC case, which 
is intuitively satisfying. 

The average noise power in the message bandwidth W is WN). Thus the 
channel signal-to-noise ratio of a coherent-receiver with SSB modulation 
is 


A2P 


(SNR )c.ssa = 4WN, (9.14) 


The transmission bandwidth B = W. The midband frequency of the 
power spectral density Sy(f) of the narrow-band noise (t) differs from 
the carrier frequency f. by W/2. Therefore, we may express n(t) as 


n(t) = nt) cos|2e(f = *) | = no(t) sin|2a(f = x) | (9.15) 


The output of the coherent detector, due to the combined influence of the 
modulated signal s(t) and noise v(t), is thus given by 


y(t) = = m(t) + 3n,(t) cos(xWt) + 3no(t) sin(aWt) (9.16) 
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As expected, we see that the quadrature component M(t) of the modulated 
message signal s(t) has been eliminated from the detector output, but 
unlike the case of DSBSC modulation, the quadrature component of the 
narrow-band noise n(t) now appears at the output. 

The message component in the receiver output is A,m(t)/4 so that the 
average power of the recovered message is A7P/16. The noise component 
in the receiver output is [n,(t) cos(aWt) + no(t) sin(zWt)]/2. Evaluating 
the average power of the output noise so defined, we find that it is equal 
to WN,/4 (see Exercise 2). Accordingly, the output signal-to-noise ratio 
of a system using SSB modulation in the transmitter and coherent detection 
in the receiver is given by 


A?P 


(SNR )o.ssa F ZWN, (a7) 


Hence, from Eqs. 9.14 and 9.17, the figure of merit of such a system is 


(SNR )o 
(SNR )c | ssa 


= 1 (9.18) 


Comparing Eqs. 9.12 and 9.18, we conclude that insofar as noise per- 
formance is concerned, DSBSC and SSB modulation systems using co- 
herent detection in the receiver have the same performance as baseband 
transmission. The only effect of the modulation process is to translate the 
message signal to a different frequency band. 


EXERCISE 2 Consider the two elements of the noise component in the 
SSB receiver output of Eq. 9.16. 


(a) Sketch the power spectral density of the in-phase noise component 
- n,(t) and quadrature noise component no(t). 
(b) Show that the average power of the modulated noise n,(t) cos(z Wt) 
or no(t) sin(aWt) is WN,/2. ; 
(c) Hence, show that the average power of the output noise is WN,/4. 


EXERCISE 3 The signal x(t) at the detector input of a coherent SSB 
receiver is defined by ~*~ 


x(t) = s(t) + n(t) 


where the signal component s(t) and noise component n(t) are henes, 
-defined by Eqs. 9.13 and 9.15, respectively. Show that: a 


(a) The average power of the signal component s(t) is A2P/4. 
(b) The average power of the noise component n(t) is WN). 
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(c) The signal- -to-noise ratio at the detector input is 


A?P 
(SNR)iss0 = = AWN, 


(@) The input and output signal- -to-noise ratios are oo by 


(SNR)issa T (SNR)o,sse 


roaroa aO 9.4 NOISE IN AM RECEIVERS USING ENVELOPE DETECTION 


In a standard amplitude modulated (AM) wave both sidebands and the 
carrier are transmitted. The AM wave may be written as 


s(t) = A[1 + k,m(t)] cos(2zf,t) (9.19) 


where A, cos(2zf,t) is the carrier wave, m(t) is the message signal, and k, 
is a constant that determines the percentage modulation. In this section, 
we evaluate the noise performance of an AM receiver using an envelope 
detector. As explained in Section 7.1, an envelope detector consists simply 
of a nonlinear device (usually a diode) followed by a low-pass RC filter. 

From Eq. 9.19, the average power in the modulated message signal s(t) 
is equal to A2?(1 + k2P)/2, where P is the average power of the message 
signal. With an average noise power of WN, in the message bandwidth, 
W, the channel signal-to-noise ratio is therefore 


A2(1 + k2P) 


(SNR) cam = ae 


(9.20) 


The received signal x(t) at the envelope detector input consists of the 
modulated message signal s(t) and narrow-band noise n(t). Representing 
n(t) in terms of its in-phase and quadrature components, namely, n,(t) 
and no(t), we may express x(t) as 


x(t) = s(t) + n(t) 
[A, + A,k,m(t) + n,(t)] cos(27f,t) — no(t) sinQzf,t) (9.21) 


It is informative to represent the components that comprise the signal x(t) 
by means of phasors, as in Fig. 9.5. From this phasor diagram, the receiver 
output is obtained as 


y(t) 


envelope of x(t) 
{{A, + Ackam(t) + n,(t))? + no(t)}? (9.22) 


The signal y(t) defines the output of an ideal envelope detector. The phase 
of x(t) is of no interest to us, because an ideal envelope detector is totally 
insensitive to variations in the phase of x(t). 
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| 
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Figure 9.5 
Phasor diagram for AM wave plus narrow-band noise for the case of high 
carrier-to-noise ratio. 


The expression defining y(t) is somewhat complex and needs to be 
simplified in some manner. Specifically, we would like to approximate the 
output y(t) as the sum of a message term plus a term due to noise. In 
general, this is difficult to achieve. However, when the average carrier 
power is large compared with the average noise power, so that the receiver 
is operating satisfactorily, then the signal term A,[1 + k,m(t)] will be large 
compared with the noise terms n,(t) and no(t), most of the time. Then we 
may approximate the output y(t) as 


y(t) = A, + A.k,m(t) + nt) (9.23) 


The presence of the dc or constant term A, in the envelope detector 
output y(t) of Eq. 9.23 is due to demodulation of the transmitted carrier 
wave. We may ignore this term, however, because it bears no relation 
whatsoever to the message signal m(t). In any case, it may be removed 
simply by means of a blocking capacitor. Thus, if we neglect the term A, 
in Eq. 9.23, we find that the remainder has, except for scaling factors, the 
same form as the output of a DSBSC receiver using coherent detection. 
Accordingly, the output signal-to-noise ratio of an AM receiver using an 
envelope detector is approximately 


A? k? P 


(SNR)o,am = WN, 


(9.24) 


This expression is, however, valid only if: 


1. The noise, at the receiver input, is small compared to the signal. 


2. The amplitude sensitivity k, is adjusted for a percentage modulation 
less than or equal to 100%. 


Using Eqs. 9.20 and 9.24, we obtain the figure of merit 


(SNR)o | _ RP 


(SNR)c lam 1+ KP (9.25) 


Thus, whereas the figure of merit of a DSBSC or SSB receiver using 
coherent detection is always unity, the corresponding figure of merit of an 
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AM receiver using envelope detection is always less than unity. In other 
words, the noise performance of an AM receiver is always inferior to that 
of a DSBSC or SSB receiver. This is owing to the wasteage of transmitted 
power that results from transmitting the carrier as a component of the AM 
wave. 


BOUOOCCOCRIIOUQOE OS ACH o 00 npon o COD CO CCOCIGICOR COC COD nonno o n ODO OO COSC CEO OCI COCO Seeeeccccccosvvcsseseeenesese 


EXAMPLE 1 SINGLE-TONE MODULATION 


Consider the special case of a sinusoidal wave of frequency f,, and ampli- 
tude A,, as the modulating wave, as shown by 


m(t) = Am cos(27f pt) 
The corresponding AM wave is 
s(t) = A1 + uw cos(2zf,»t)] cos(2zf,t) 


where u = k,A,, is the modulation factor. The average power of the 
modulating wave m(t) is 


Therefore, using Eq. 9.25, we get 


(SNR)o | _ _2kAn 
(SNR)c lam 1 + 4k2A3, 
we 
= 32 


When u = 1, which corresponds to 100% modulation, we get a figure of 
merit equal to 1/3. This means that, other factors being equal, this AM 
system must transmit three times as much average power as a suppressed- 
carrier system in order to achieve the same quality of noise performance. 


EXERCISE 4 The carrier-to-noise ratio of a communication receiver is 
ofred aby, o 


Average carrier power _ 


(9.27) 


ed (Average noise power in bandwidth of the 
-modulated wave at the receiver input 


Beoreceeccosscocesessosessese 


eeaesccococoscrecces 


weccoeceasccoceocenseeeees 
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~ Show that for a standard AM receiver, — 


Ce) : 


E the ‘output signal- -to-noise ratio g Eq 2. Ai in terms Lof the carrier- 
torqpise ratio oH . a 


THRESHOLD EFFECT 


When the carrier-to-noise ratio at the receiver input of a standard AM 
system is small compared with unity, the noise term dominates and the 
performance of the envelope detector changes completely from that just 
described. In this case it is more convenient to represent the narrow-band 
noise n(t) in terms of its envelope r(t) and phase y(t), as shown by 


n(t) = r(t) cos[2nf.t + w(t) (9.29) 


The phasor diagram for the detector input x(t) = s(t) + n(t) 
is shown in Fig. 9.6 where we have used the noise as reference, because 
it is now the dominant term. To the noise phasor r(t) we have added a 
phasor representing the signal term A,[1 + k,m(t)], with the angle between 
them equal to y(t), the phase of the noise n(t). In Fig. 9.6 it is assumed 
that the carrier-to-noise ratio is so low that the carrier amplitude A, is 
small compared with the noise envelope r(t), most of the time. Then we 
may neglect the quadrature component of the signal with respect to the 
noise, and thus find directly from Fig. 9.6 that the envelope detector output 
is approximately 


y(t) = r(t) + A. cos[y(t)] + A.kam(t) cos[y(t)] (9.30) 


This relation reveals that when the carrier-to-noise ratio is low, the detector 
output has no component strictly proportional to the message signal m(t). 
The last term of the expression defining y(t) contains the message signal 
m(t) multiplied by noise in the form of cos[y(t)]. The phase w(t) of a 
narrow-band noise n(t) is uniformly distributed over 2z radians; that is, it 
can assume a value anywhere between 0 and 2z with equal probability. It 
follows therefore that we have a complete loss of information in that the 


Resultant 
suntan — 7 A. +t A,k mit) 


r(t) Eo 
y (t) 
Figure 9.6 


Phasor diagram for AM wave plus narrow-band noise for the case of low 
carrier-to-noise ratio. 
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detector output does not contain the message signal m(t) at all. The loss 
of a message in an envelope detector that operates at a low carrier-to-noise 
ratio is referred to as the threshold effect. By threshold we mean a value 
of the carrier-to-noise ratio below which the noise performance of a detector 
deteriorates much more rapidly than that predicted by Eq. 9.24 assuming a 
high carrier-to-noise ratio. It is important to recognize that every nonlinear 
detector (e.g., envelope detector) exhibits a threshold effect. On the other 
hand, such an effect does not occur in a coherent detector. 

A detailed analysis of the threshold effect in envelope detectors is com- 
plicated.” We may develop some insight into the threshold effect, however, 
by using the following qualitative approach.* Let R denote the random 
variable obtained by observing the envelope process, with sample function 
r(t), at some fixed time. Intuitively, an envelope detector is expected to 
be operating well into the threshold region if the probability that the ran- 
dom variable R exceeds the carrier amplitude A, is, say, 0.5. On the other 
hand, if this same probability is only 0.01, the envelope detector is expected 
to be relatively free of loss of message and threshold effects. The evaluation 
of the carrier-to-noise ratios, corresponding to these probabilities, is best 
illustrated by way of an example. 


PYTTT TITTLE irri rrr ree) 


EXAMPLE 2 


From Section 8.14 we recall that the envelope r(t) of a narrow-band Gaus- 
sian noise n(t) is Rayleigh-distributed. Specifically, the probability density 
function of the random variable R obtained by observing the envelope r(t) 
at some fixed time, is given by 


2 
fr(r) = = exp( - ca (9.31) 


where c% is the variance of the noise n(t). For an AM system, we have 
o% = 2WN). Therefore the probability of the event R = A, is defined by 


P(R > A.) = N fr(r) dr 


N Faal- a a 
a. 2WN, 4WN, 
AZ 
Se eee 9.32 
exo a whee 


2See Middleton (1960), pp. 563-574. 
3See Downing (1964), p. 71. 
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Using Eq. 9.28 for the carrier-to-noise ratio of an AM receiver, we may 
rewrite Eq. 9.32 in the compact form 


P(R 2 A.) = exp(—p) (9.33) 
Solving for P(R = A.) = 0.5, we get 
p = In2 = 0.69 = —1.6 dB 
Similarly, for P(R = A.) = 0.01, we get 
= ]n100 = 4.6 = 6.6 dB 


Thus with a carrier-to-noise ratio of —1.6 dB the envelope detector is 
expected to be well into the threshold region, whereas with a carrier-to- 
noise ratio of 6.6 dB the detector is expected to be operating satisfactorily. 
We ordinarily need a signal-to-noise ratio considerably greater than 6.6 dB 
for satisfactory fidelity, which means therefore that threshold effects are 
seldom of great importance in AM receivers using envelope detection. : 


COO SOO CEO CT EEO S EES OESHOEESSSAO OES ESESOSTES SESE HF SESOESOOS OES TTET TTT TT TTTTTTTTTTTITTTITTITTTTTTTTTTTTTITTTYTTTITTTTTTETS 


EXERCISE 5 Given a carrier-to-noise ratio of 6.6 dB for which the en- 
velope detector of an AM receiver operates satisfactorily, what is ‘the 

| corresponding value of channel signal-to-noise ratio for the case of sinu- 
soidal modulation with 100% mon Eron ; 


ooroo oaot 9.5 FM RECEIVER MODEL 


We turn next to study the effects of noise on the performance of FM 
receivers. Here again we require a receiver model to carry out the analysis. 
Figure 9.7a shows the details of an idealized FM receiver model that satisfies 
our requirement. As before, the noise w(t) is modeled as white noise of 
zero mean and power spectral density No/2. The received FM signal s(t), 
translated in frequency and amplitude, has a carrier frequency f, and trans- 
mission bandwidth B, so that only a negligible amount of power lies outside 
the frequency band fe — B/2 < |f| < f + B/2. The FM transmission 
bandwidth B is in excess of twice the message bandwidth W by an amount 
that depends on the deviation ratio of the incoming frequency modulated 
wave; see Section 7.11. 

As in the AM case, the IF filter in the model of Fig. 9.7a represents 
the combined filtering effects of the RF and IF sections of an FM receiver 
of the superheterodyne type. This filter has a midband frequency f, and 
bandwidth B, and therefore passes the FM signal essentially without dis- 
tortion. We assume that the IF filter in Fig. 9.7a has an ideal bandpass 
characteristic, with the bandwidth B small compared with the midband 
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Baseband 
low-pass 
filter 


Output 
signal 


Discriminator 


W—>(S) 4 Limiter 
+ 


(a) 


(b) 


Figure 9.7 
Modeling of an FM receiver. (a) Model. (b) Idealized IF filter characteristic. 


frequency f., as in Fig. 9.7b. We may thus use the usual narrow-band 
representation for the filtered noise n(¢) in terms of its in-phase and quad- 
rature components. 

The limiter is included in Fig. 9.7a to remove any amplitude variations 
at the IF output. The discriminator is assumed to be ideal in the sense that 
its output is proportional to the deviation in the instantaneous frequency 
of the carrier away from f,. Also, the postdetection filter is assumed to 
be an ideal low-pass filter with a bandwidth equal to the message band- 
width W. 


9.6 NOISE IN FM RECEPTION 


For the noise analysis of FM receivers, we find it convenient to express 
the narrow-band noise n(t) at the IF filter output in terms of its envelope 
and phase as in Eq. 9.29. This relation is reproduced here for convenience: 


n(t) = r(t) cos[2zf,t + y(t)| (9.34) 


The envelope r(t) and phase w(t) are themselves defined in terms of the 
in-phase component n,(t) and quadrature component no(t) as follows: 


r(t) = [ni(t) + no)” (9.35) 
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and 


y(t) = tan 220) (9.36) 


We assume that the FM signal at the IF filter output is given by 
s(t) = A, cos|2nft + 2k; ih m(t) a (9.37) 
0 


where A, is the carrier amplitude, f. is the carrier frequency, kp is the 
frequency sensitivity, and m(t) is the message or modulating wave. For 
convenience of presentation, we define 


$(t) = 27k; [ ‘ m(t) dt (9.38) 


We may then express s(t) in the simple form 
s(t) = A, cos[2zf,t + (t)] (9.39) 
The total signal (i.e., signal plus noise) at the IF section output is therefore 


x(t) = s(t) + n(t) 
A, cos[2zf,t + @(t)] + r(t) cos[2xf,t + w(t)] (9.40) 


It is informative to represent x(t) by means of a phasor diagram, as in Fig. 
9.8. In this diagram we have used the signal term as reference. The relative 
phase 6(t) of the resultant phasor representing x(t) is obtained directly 
from Fig. 9.8 as 


r(t) sin[v(t) — $(4)] 
A. + r(t) cos[w(t) — $(¢)] 


The envelope of x(f) is of no interest to us, because any envelope variations 
at the IF section output are removed by the limiter. 


Resultant 
(t) 
a Ot) = 10) ie. 
į 


A 
¥(t) ole) 


Olt) = g(t) + tan} | (9.41) 


Cc 


Figure 9.8 
Phasor diagram for FM wave plus narrow-band noise for the case of high 
carrier-to-noise ratio. 
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Our motivation is to determine the error in the instantaneous frequency 
of the carrier wave caused by the presence of the narrow-band noise n(t). 
With the discriminator assumed ideal, its output is proportional to 0(t), 
where 6(ft) is the derivative of 6(t) with respect to time. In view of the 
complexity of the expression defining 0(t), however, we need to make 
certain simplifying approximations so that our analysis may yield useful 
results. 

We assume that the carrier-to-noise ratio measured at the discriminator 
input is large compared with unity. Then, most of the time, the expression 
for the relative phase (t) simplifies as 


a(t) = g(a) + 


Py 
term noise term 


sin[y(t) — $(2)] (9.42) 


The signal term $(¢) is proportional to the integral of the message signal 
m(t), as in Eq. 9.38. Hence, using Eqs. 9.38 and 9.42, we find that the 
discriminator output is 


=k;m(t) + n,(t) (9.43) 


where the noise term n,(t) is defined by 
O = Fo sinye) - AON (9.44) 
m Aa i 


We thus see that provided the carrier-to-noise ratio is high, the discrimi- 
nator output v(t) consists of a scaled version of the original message signal 
m(t), plus an additive noise component n,(t). Accordingly, we may use 
the output signal-to-noise ratio as previously defined to assess the quality 
of performance of the FM receiver. 

The output signal-to-noise ratio is defined as the ratio of the average 
output signal power to the average output noise power. From Eq. 9.43, 
the signal component at the discriminator output, and therefore the post- 
detection filter output, is kym(t). Hence, the average output signal power 
is k4P, where P is the average power of the message signal m(t). 

Unfortunately, the calculation of the average output noise power is 
complicated by the presence of the factor sin[y(t) — $(t)] in Eq. 9.44. 
Since the phase y(t) is uniformly distributed over 27 radians, the mean- 
square value of the noise n,(t) in Eq. 9.44 will be biased by the message- 
dependent phase ¢(t). The presence of $(t) produces components in the 
power spectrum of the noise n,(t) at frequencies that lie outside the message 
band. However, such frequency components do not appear at the receiver 
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output as they are rejected by the post-detection filter.* Hence, insofar as 
the calculation of inband noise power at the receiver output due to na(t) 
is concerned, we may simplify our task by setting the message-dependent 
phase ¢(t) equal to zero. Under this condition, Eq. 9.44 simplifies as 


oie 


Gap (9.45) 


nt) = 


From the definitions of the noise envelope r(t) and phase y(t) given by 
Eqs. 9.35 and 9.36, we note that the quadrature component of the narrow- 
band noise n(t) is 


noli) = r(t) sinfy(0)] (9.46) 
Correspondingly, Eq. 9.45 may be rewritten as 


_1 dno(t) 


2nA, dt Cao 


ng(t) = 


We may thus state that, under the condition of high carrier-to-noise ratio, 
the calculation of the average output noise power in an FM receiver depends 
only on the carrier amplitude A. and the quadrature noise component no(t). 
Stated in another way, we may use an unmodulated carrier to calculate the 
output signal-to-noise ratio of an FM receiver, provided that the carrier- 
to-noise ratio is high. 

From Section 2.3, we recall that differentiation of a function with respect 
to time corresponds to multiplication of its Fourier transform by j2zf. It 
follows therefore that we may obtain the noise process n,(t) by passing 
no(t) through a linear filter with a transfer function equal to 


eI). 


aa, (9.48) 


This means that the power special density Sy (f) of the noise n,(t) is related 
to the power spectral density Sy,(f) of the quadrature noise component 
no(t) as follows: 


Su) = G Sul) (9.49) 


With the IF filter in Fig. 9.7a assumed to have an ideal band-pass 
characteristic of bandwidth B and midband frequency f,, it follows that the 


“See Downing (1964), pp. 96-98. 
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narrow-band noise n(t) will have a power spectral density characteristic 
that is similarly shaped. This means that the quadrature component no(t) 
_ of the narrow-band noise n(t) will have the ideal low-pass characteristic 
shown in Fig. 9.9a. The corresponding power spectral density of the noise 
n,(t) is shown in Fig. 9.9b. That is, 


Nate B 

i ay AD 9.50 
Sn (f) = c 4 ( i ) 

0, otherwise 


The discriminator output is followed by a low-pass filter with a band- 
width equal to the message bandwidth W. For wideband FM, by definition, 


Sy (f) 
Na 


Figure 9.9 

Noise analysis of FM receiver. (a) Power spectral density of quadrature component 
nalt) of narrow-band noise n\t). (b) Power spectral density of noise nalt) at 
discriminator output. (c) Power spectral density of noise no(t) at receiver output. 
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W is much smaller than B/2 where B is the transmission bandwidth of the 
FM signal. This means that the out-of-band components of noise n,(t) will 
be rejected. Therefore, the power spectral density Sy,(f) of the noise no(t) 
appearing at the receiver output is defined by 


NË flew 


Syo(f) = 4 Ae’ (9.51) 
0, otherwise 


as shown in Fig. 9.9c. The average output noise power is determined by 
integrating the power spectral density Sy,(f) from —W to W. We thus get 
No (W 
Average power of output noise = E | pods 
ae W 


_ 2N) W? 
~ 3A? 


(9.52) 


Note that the average output noise power is inversely proportional to the 
average carrier power A?/2. Accordingly, in an FM system, increasing the 
carrier power has a noise-quieting effect. 

Earlier we determined the average output signal power as k;P. There- 
fore, provided the carrier-to-noise ratio is high, we may divide this average 
output signal power by the average output noise power of Eq. 9.52 to 
obtain the output signal-to-noise ratio 


3A? k? P 
2N,W? 


(SNR)o,rm = (9.53) 


The average power in the modulated signal s(t) is A?/2, and the average 
noise power in the message bandwidth is WNo. Thus the channel signal- 
to-noise ratio is 


2 


(SNR) crm = WN, (9.54) 


Dividing the output signal-to-noise ratio by the channel signal-to-noise 
ratio, we get the figure of merit 


(SNR)o | _ 3k3P 


(SNR)c ley W? ve 


The frequency deviation 4f is proportional to the frequency sensitivity 
k; of the modulator. Also, by definition, the deviation ratio D is equal to 
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the frequency deviation Af divided by the message bandwidth W. There- 
fore, it follows from Eq. 9.55 that the figure of merit of a wideband FM 
system is a quadratic function of the deviation ratio. Now, in wideband 
FM, the transmission bandwidth B is approximately proportional to the 
deviation ratio D. Accordingly, we may state that when the carrier-to-noise 
ratio is high, an increase in the transmission bandwidth B provides a cor- 
responding quadratic increase in the output signal-to-noise ratio or figure of 
merit of the FM system. 


EXAMPLE 3 SINGLE-TONE MODULATION 


Consider the case of a sinusoidal wave of frequency fm as the modulating 
wave, and assume a frequency deviation 4 f. The modulated wave is thus 
defined by 


s(t) = A, cos| 2 ft + = sin rf | 


where we have made the substitution: 
nk; f aa = — Í sin(2nfnt) 


Differentiating both sides with respect to time: 


m(t) = - cos(2r fmt) 


Hence, the average power of the message signal m(t) is 


(4fY 


B- e 


Substituting this result into the formula for the output signal-to-noise ratio 
given by Eq. 9.53, we get 


CITIL TTET TTT OS OSES SOOO SOS ETOH OOS EH SESS OTESSS OT SOOSEEOSHSSSOSSOSSSOSSOTT IST SSESSOSSESORS 


_ 3A2(4fY 
~4N)W3 
ABs 
~ 4N,W 


(SNR )o, FM — 


(9.56) 


where $ = 4f/W is the modulation index. Using Eq. 9.55 to evaluate the 


516 NOISE IN ANALOG MODULATION 


corresponding figure of merit, we get 


(SNR )o -3(4 fy 
m? 

3 

= r 


(SNR)c 


(9.57) 


It is important to note that the modulation index 8 = 4 f/W is determined 
by the bandwidth W of the postdetection low-pass filter and is not related 
to the sinusoidal message frequency fm, except insofar as this filter is chosen 
so as to pass the spectrum of the desired message. For a specified bandwidth 
W the sinusoidal message frequency f,, may lie anywhere between 0 and 
W and would yield the same output signal-to-noise ratio. 

It is of particular interest to compare the performance of AM and FM 
systems. One way of making this comparison is to consider the figures of 
merit of the two systems based on a sinusoidal modulating signal. For an 
AM system operating with a sinusoidal modulating signal and 100% mod- 
ulation, we have (from Example 1): 


íl 
3 (9.58) 


Comparing this figure of merit with the corresponding result obtained for 
an FM system, we see that the use of frequency modulation offers the 
possibility of improved signal-to-noise ratio over amplitude modulation 
when 


3 > 3 
that is, 
LENS 


We may therefore consider $ = 0.5 as defining roughly the transition from 
narrow-band FM to wideband FM. This statement, based on noise consid- 
erations, further confirms a similar observation that was made in Chapter 
7 when considering the bandwidth of FM waves. 
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EXERCISE 6 Consider an FM receiver with an IF filter of bandwidth B. 
The incoming FM wave is produced by a sinusoidal modulation that pro- 
duces a frequency deviation 4f equal to B/2, so that the carrier swings | 
back and forth across the entire passband of the IF filter. Using the defi- es 
nition of the carrier-to-noise ratio 


Ag 
2BNo 


p= (9.59) 3 
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_ show that for the situation described herein the output signal-to-noise ratio 
of the FM receiver is 


(SNR)o = (2) 9.60) 


where W is the message bandwidth and B is the IF filter bandwidth. 


COMPARISON OF FM WITH PCM 


In this subsection, we compare the capabilities of wideband FM and PCM 
for exchanging an increase in transmission bandwidth for an improvement 
in noise performance. With wideband FM, the improvement in signal-to- 
noise ratio produced by increased transmission bandwidth effectively fol- 
lows a square law (see Eq. 9.55). That is, by doubling the bandwidth in 
an FM system that operates above threshold, the signal-to-noise ratio is 
improved by 6 dB. With binary PCM limited by quantizing noise, on the 
other hand, doubling the transmission bandwidth permits twice the number 
of binary digits n in a code word, and therefore increases the signal-to- 
noise ratio by 6n dB (see Eq. 5.24). It follows therefore that FM is less 
efficient than PCM in exchanging increased bandwidth for improved signal- 
to-noise ratio. 


CAPTURE EFFECT 


The inherent ability of an FM system to minimize the effects of unwanted 
signals (e.g., noise, as discussed earlier) also applies to interference pro- 
duced by another frequency-modulated signal with a frequency content 
close to the carrier frequency of the desired FM wave. However, inter- 
ference suppression in an FM receiver works well only when the interfer- 
ence is weaker than the desired FM input. When the interference is the 
stronger one of the two, the receiver locks on to the stronger signal and 
thereby suppresses the desired FM input. When they are of nearly equal 
strength, the receiver fluctuates back and forth between them. This phe- 
nomenon is known as the capture effect. 


Teon conenoose 9.7 FM THRESHOLD EFFECT 


The formula of Eq. 9.53, defining the output signal-to-noise ratio of an | 
FM receiver, is valid only if the carrier-to-noise ratio, measured at the 
discriminator input, is high compared with unity. It is found experimentally 
that as the input noise is increased so that the carrier-to-noise ratio is 
decreased, the FM receiver breaks. At first, individual clicks are heard in 
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the receiver output, and as the carrier-to-noise ratio decreases still further, 
the clicks rapidly merge into a crackling or sputtering sound. Near the 
breaking point, Eq. 9.53 begins to fail by predicting values of output signal- 
to-noise ratio larger than the actual ones. This phenomenon is known as 
the threshold effect. The threshold is defined as the minimum carrier-to- 
noise ratio yielding an FM improvement that is not significantly deteriorated 
from the value predicted by the signal-to-noise formula of Eq. 9.53 assuming 
a small noise power. 

For a qualitative discussion of the FM threshold effect, consider first the 
case when there is no signal present, so that the carrier wave is unmodu- 
lated. Then the composite signal at the frequency discriminator input is 


x(t) = [A, + n,(t)] cos(2zf.t) — no(t) sin(2r f.t) (9.61) 


where n,(t) and ng(t) are the in-phase and quadrature components of the 
narrow-band noise n(t) with respect to the carrier wave cos(2zf,t). The 
phasor diagram of Fig. 9.10 shows the phase relations between the various 
components of x(t) in Eq. 9.61. As the amplitudes and phases of n,(t) and 
no(t) change with time in a random manner, the point P wanders around 
the point Q. When the carrier-to-noise ratio is large, n,(t) and no(t) are 
usually much smaller than the carrier amplitude A., so the wandering point 
P in Fig. 9.10 spends most of its time near point Q. Thus the angle 0(t) 
is approximately no(t)/A, to within a multiple of 27. The wandering point 
P occasionally sweeps around the origin and @(t) increases or decreases 
by 2z radians. Figure 9.11 illustrates how, in a rough way, these excursions 
in O(t) produce impulse-like components in @(t) = d6/dt. The discrimi- 
nator output v(t) is equal to 6(t)/2z. These impulse-like components have 
different heights depending on how close the wandering point P comes to 
the origin O, but all have areas nearly equal to +27 radians. When the 
signal shown in Fig. 9.115 is passed through the postdetection low-pass 
filter, corresponding but wider impulse-like components are excited in the 
receiver output and are heard as clicks. The clicks are produced only when 
O(t) changes by +2z. 

From the phasor diagram of Fig. 9.10, we may deduce the conditions 
required for clicks to occur. A positive-going click occurs when the en- 


Figure 9.10 
A phasor diagram interpretation of Eq. 9.61. 
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A(t) 


| (a) 


6 (r) 


(b) 


Figure 9.11 
Impulse-like components in 8(t) = d6(t)/dt produced by changes of 2m in O(t). 


velope r(t) and phase y(t) of the narrow-band noise n(t) satisfy the fol- 
lowing conditions: 


r(t) >A, 
y(t) <n < w(t) + dy(t) 


dy(t) 
T 0 


These conditions ensure that the phase 0(t) of the resultant phasor x(t) 
changes by 2z radians in the time increment dt, during which the phase 
of the narrow-band noise increases by the incremental amount dy (t). 
Similarly, the conditions for a negative-going click to occur are 


r(t) > A. 
y(t) > -7 > y(t) + dy(t) 
dy (t) 


—— < 
dt ; 
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These conditions ensure that 0(t) changes by — 27 radians during the time 
increment dt. 

As the carrier-to-noise ratio is decreased, the average number of clicks 
per unit time increases. When this number becomes appreciably large, the 
threshold is said to occur. Consequently, the output signal-to-noise ratio 
deviates appreciably from a linear function of the carrier-to-noise ratio 
when the latter falls below the threshold. 

This effect is well illustrated in Fig. 9.12, which is calculated from theory.’ 
The calculation is based on the following two assumptions: 


1. The output signal is taken as the receiver output measured in the absence 
of noise. The average output signal power is calculated for a sinusoidal 
modulation that produces a frequency deviation 4f equal to one half 


40 


20 


Output signal-to-noise ratio 10 log,,)(SNR)g, dB 


10 
0 10 20 


Input carrier-to-noise ratio 10 log), p, dB 


Figure 9.12 
Variation of output signal-to-noise ratio with input carrier-to-noise ratio, 
demonstrating the FM threshold effect. 


5For a detailed theoretical account of noise in FM receivers, see the classic papers 
by Rice (1948) and Stumpers (1948). Figure 9.12 is adapted from another paper by 
Rice (1963). 
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of the IF filter bandwidth B; the carrier is thus enabled to swing back 
and forth across the entire IF band. 


2. The average output noise power is calculated when there is no signal 
present; that is, the carrier is unmodulated, with no restriction placed 
on the value of the carrier-to-noise ratio. 


The curve plotted in Fig. 9.12 is for the ratio (B/2W) = 5. The linear 
part of the curve corresponds to the limiting value of 3p(B/2W)’; see 
Exercise 6. Figure 9.12 shows that, owing to the threshold phenomenon, 
the output signal-to-noise ratio deviates appreciably from a linear function 
of the carrier-to-noise ratio p when p becomes less than a threshold of 10 
dB. 

The threshold carrier-to-noise ratio, pa, depends on the ratio of IF filter 
bandwidth-to-message bandwidth, B/W. Also, the value of p, is influenced 
by the presence of modulation. Nevertheless, these variations are usually 
small enough to justify taking pm as about 10 dB for most practical cases 
of interest. We may thus state that the loss of message at an FM receiver 
output is negligible if the carrier-to-noise ratio satisfies the condition 


A? 
g > ; 
ee (9.62) 


Since the channel signal-to-noise ratio (SNR)c = A2?/2WNpo, we may re- 
formulate this condition as 


10B 
(SNR) ¢ = ae (9.63) 


The IF filter bandwidth B is ordinarily designed to equal the FM trans- 
mission bandwidth. Hence, we may use Carson’s rule to relate B to the 
message bandwidth W as follows (see Section 7.11) 


B = 2W(1 + D) 
where D is the deviation ratio; for sinusoidal modulation, the modulation 
index £ is used in place of D. Accordingly, we may restate the condition 
for ensuring no significant loss of message at an FM receiver output as 
(SNR)c = 20(1 + D) (9.64) 


or, in terms of decibels, 
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EXERCISE 7 Calculate the condition on the channel signal-to-noise ratio 
to avoid the FM threshold effect for the following values of deviation ratio: 


(a) D = 2 
(b) D=5 
Suppose that the FM receiver operates with the following parameters: 
W = 15 kHz 
> = 0.5 x 10-8 W/Hz ` 


Find the corresponding condition on the average transmitted power for 
case (a) and case (b). 


FM THRESHOLD REDUCTION 


In certain applications such as space communications, there is a particular 
interest in reducing the noise threshold in an FM receiver so as to satis- 
factorily operate the receiver with the minimum signal power possible. 
Threshold reduction in FM receivers may be achieved by using an FM 
demodulator with negative feedback (commonly referred to as an FMFB 
demodulator), or by using a phase-locked loop demodulator. 

Figure 9.13 is a block diagram of an FMFB demodulator. We see that 
the local oscillator of the conventional FM receiver has been replaced by 
a voltage-controlled oscillator (VCO) with an instantaneous output fre- 
quency that is controlled by the demodulated signal. To understand the 
operation of this receiver, suppose for the moment that the VCO is re- 
moved from the circuit and the feedback loop is left open. Assume that 
a wideband FM wave is applied to the receiver input, and a second FM 
wave, from the same source but with a modulation index a fraction smaller, 
is applied to the VCO terminal of the product modulator. The output of 
the product modulator consists of two components: a sum-frequency com- 
ponent and a difference-frequency component. The IF filter (following the 
product modulator) is designed to pass only the difference-frequency com- 
ponent. (The combination of the product modulator and the IF filter in 
Fig. 9.13 constitutes a mixer.) The frequency deviation of the IF filter 
(mixer) output would be small, although the frequency deviation of both 
input FM waves is large, since the difference between their instantaneous 
deviations is small. Hence, the modulation indices would subtract, and the 
resulting FM wave at the IF filter (mixer) output would have a smaller 


Our treatment of the FMFB demodulator is based on Enole (1962). See also Roberts 
(1977), pp. 166-181. 
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Figure 9.13 
FMFB demodulator. 


modulation index than the input FM waves. This means that the IF filter 
bandwidth in Fig. 9.13 need only be a fraction of that required for either 
wideband FM wave. The FM wave with reduced modulation index passed 
by the IF filter is then frequency-demodulated by the combination of lim- 
iter/discriminator and finally processed by the baseband filter. It is now 
apparent that the second wideband FM wave applied to the product mod- 
ulator may be obtained by feeding the output of the baseband low-pass 
filter back to the VCO, as in Fig. 9.13. 

It will now be shown that the signal-to-noise ratio of an FMFB receiver 
is the same as that of a conventional FM receiver with the same input 
signal and noise power if the carrier-to-noise ratio is sufficiently large. 
Assume for the moment that there is no feedback around the demodulator. 
In the combined presence of an unmodulated carrier A, cos(27f,t) and a 
narrow-band noise 


n(t) = n,(t) cos(2zf,t) — no(t) sin(27 f.t), 


the phase of the composite signal x(t) at the limiter—discriminator input is 
approximately equal to ng(t)/A,. This assumes that the carrier-to-noise 
ratio is high. The envelope of x(t) is of no interest to us, because the 
limiter removes all variations in the envelope. Thus the composite signal 
at the frequency discriminator input consists of a small index phase-mod- 
ulated wave with the modulation derived from the component no(t) of 
noise that is in phase quadrature with the carrier. When feedback is applied, 
the VCO generates a wave that reduces the phase-modulation index of the 
wave at the IF filter output, that is, the quadrature component no(t) of 
noise. Thus we see that as long as the carrier-to-noise ratio is sufficiently 
large, the FMFB receiver does not respond to the in-phase noise component 
n,(t), but that it would demodulate the quadrature noise component no(t) 
in exactly the same fashion as it would demodulate the signal. Signal and 
quadrature noise are reduced in the same proportion by the applied feed- 
back, with the result that the baseband signal-to-noise ratio is independent 


eecccscceocezeeces 
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of feedback. For large carrier-to-noise ratios the baseband signal-to-noise 
ratio of an FMFB receiver is then the same as that of a conventional FM 
receiver. 

The reason why an FMFB receiver is able to extend the threshold is 
that, unlike a conventional FM receiver, it uses a very important piece of 
a priori information, namely, that even though the carrier frequency of 
the incoming FM wave will usually have large frequency deviations, its 
rate of change will be at the baseband rate. An FMFB demodulator is 
essentially a tracking filter that can track only the slowly varying frequency 
of wideband FM waves. Consequently it responds only to a narrow band 
of noise centered about the instantaneous carrier frequency. The bandwidth 
of noise to which the FMFB receiver responds is precisely the band of 
noise that the VCO tracks. The net result is that an FMFB receiver is 
capable of realizing a threshold reduction on the order of 5—7 dB, which 
represents a significant improvement in the design of minimum-power FM 
systems. 

The phase-locked loop demodulator, which was described in Section 
7.12, exhibits threshold reduction properties that are similar to those of 
the FMFB demodulator. Thus, like the FMFB demodulator, a phase-locked 
loop is a tracking filter and, as such, the bandwidth of noise to which it 
responds is precisely the band of noise that the VCO tracks. However, 
although the thresholds of the phase-locked loop and FMFB demodulators 
occur because of the same basic mechanism, the details by which they 
occur are, of course, different.’ Practical experience with the phase-locked 
loop, however, confirms the conclusion that very comparable performance 
with the FMFB demodulator is obtained in many situations, so that the 
choice between these two types of threshold-extension devices is often 
made in favor of the phase-locked loop because of its simpler construction. 


9.8 PRE-EMPHASIS AND DE-EMPHASIS IN FM 


In Section 9.6 we showed that the power spectral density of the noise at 
the receiver output has a square-law dependence on the operating fre- 
quency; this is illustrated in Fig. 9.14a. In part b of this figure we have 
included the power spectral density of a typical message source; audio and 
video signals typically have spectra of this form. We see that the power 
spectral density of the message usually falls off appreciably at higher fre- 
quencies. On the other hand, the power spectral density of the output noise 
increases rapidly with frequency. Thus, at f = +W, the relative spectral 
density of the message is quite low, whereas that of the output noise is 
high in comparison. Clearly, the message is not using the frequency band 
allowed to it in an efficient manner. It may appear that one way of improving 
the noise performance of the system is to slightly reduce the bandwidth of 


7See Roberts (1977), pp. 200-202. 
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Figure 9.14 
(a) Power spectral density of noise at FM receiver output. (b) Power spectral density 
of a typical message source. 


the postdetection low-pass filter so as to reject a large amount of noise 
power while losing only a small amount of message power. Such an ap- 
proach, however, is usually not satisfactory because the distortion of the 
message caused by the reduced filter bandwidth, even though slight, may 
not be tolerable. For example, in the case of music we find that although 
the high-frequency notes contribute only a very small fraction of the total 
power, nonetheless, they contribute a great deal from an aesthetic view- 
point. 

A more satisfactory approach to the efficient use of the allowed fre- 
quency band is based on the use of pre-emphasis in the transmitter and 
de-emphasis in the receiver, as illustrated in Fig. 9.15. In this method, we 
artificially emphasize the high-frequency components of the message signal 
prior to modulation in the transmitter, and therefore before the noise is 
introduced in the receiver. In effect, the low-frequency and high-frequency 
portions of the power spectral density of the message are equalized in such 
a way that the message fully occupies the frequency band allotted to it. 
Then, at the discriminator output in the receiver, we perform the inverse 
operation by de-emphasizing the high-frequency components, so as to re- 
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Figure 9.15 
Use of pre-emphasis and de-emphasis in an FM system. 
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store the original signal-power distribution of the message. In such a process 
the high-frequency components of the noise at the discriminator output 
are also reduced, thereby effectively increasing the output signal-to-noise 
ratio of the system. Such a pre-emphasis and de-emphasis process is widely 
used in FM transmission and reception. 

To produce an undistorted version of the original message at the receiver 
output, the pre-emphasis filter in the transmitter and the de-emphasis filter 
in the receiver would ideally have transfer functions that are the inverse 
of each other. That is, if H,.(f) designates the transfer function of the pre- 
emphasis filter, then the transfer function H4(f) of the de-emphasis filter 
would ideally be 


H.(f) = a —W<f<W (9.66) 


This choice of transfer functions makes the average message power at the 
receiver output independent of the pre-emphasis and de-emphasis proce- 
dure. 

The pre-emphasis filter is selected so that the average power of the 
emphasized message signal m,(t) in Fig. 9.15 has the same average power 
as the original message m(t). Thus, given the power spectral density S,,(f) 
of the message signal m(t), we may write 


[E ASA af = [7 Sul) af (9.67) 


This constraint on the transfer function H,.(f) of the pre-emphasis filter 
ensures that the bandwidth of the transmitted FM signal remains the same, 
with or without pre-emphasis. 

From our previous noise analysis in FM systems, assuming a high carrier- 
to-noise ratio, the power spectral density of the noise n,(t) at the discrim- 
inator output is 


Nof? B (9.68) 
0, otherwise 


Therefore, the modified power spectral density of the noise at the de- 
emphasis filter output is equal to |Ha(f)} Sn (f). Recognizing, as before, 
that the postdetection low-pass filter has a bandwidth W, which is, in 
general, less than B/2, we find that the average power of the modified 
noise at the receiver output is 


Average output noise | _ No {¥ 
E- with a ~ A? | Te FHG df (9.69) 


PRE-EMPHASIS AND DE-EMPHASIS IN FM 527 


Because the average message power at the receiver output is ideally un- 
affected by the pre-emphasis and de-emphasis procedure, it follows that 
the improvement in output signal-to-noise ratio produced by the use of 
pre-emphasis in the transmitter and de-emphasis in the receiver is defined 
by 


_ average output noise power without pre-emphasis and de-emphasis 
average Output noise power with pre-emphasis and de-emphasis 


Earlier we showed that the average output noise power without pre-em- 
phasis and de-emphasis is equal to 2N)W?/3A2; see Eq. 9.52. Therefore, 
after cancellation of common terms, we may write 


2W? 


[= — (9.70) 
3 ew fl Half)? af 

Note that this improvement factor assumes a high carrier-to-noise ratio at 

the discriminator input. 
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EXAMPLE 4 


A simple pre-emphasis filter that emphasizes high frequencies and that is 
commonly used in practice is defined by the transfer function 


Half) = k ( + it (9.71) 


This transfer function is closely realized by the RC-amplifier network shown 
in Fig. 9.16a, provided that R < r and 2xfCR < 1 inside the frequency 
band of interest. The amplifier in Fig. 9.16a@ is intended to make up for 
the attenuation introduced by the RC network at low frequencies. The 
frequency parameter fo is 1/(2 Cr). The corresponding de-emphasis filter 
in the receiver is defined by the transfer function 


1/k 
H = E 9.72 
which can be realized using the RC-amplifier network of Fig. 9.16b. ; 


The constant k in Eqs. 9.71 and 9.72 is chosen to satisfy the constraint 
of Eq. 9.67, which requires that the average power of the pre-emphasized 
message signal be the same as the average power of the original message 
signal. Assume that the power spectral density of the original message į 
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Figure 9.16 
(a) Pre-emphasis filter. (b) De-emphasis filter. 


signal m(t) is 


1 
Su(f) = 41 + (f/fo)? 


0 elsewhere 


Then, the use of Eqs. 9.71 and 9.73 in 9.67 yields 


lee + ci - [ea 


or 


2 _ fo 
k = Fy tare (=) 


Amplifier 


Piles 


(9.73) 


(9.74) 


Equation 9.70 defines the improvement in output signal-to-noise ratio 
of the FM receiver, resulting from the combined use of pre-emphasis and 
de-emphasis. For the pre-emphasis and de-emphasis filters of Fig. 9.16, 


the use of this equation yields the improvement 


ee ee 
m k?f? 
Be 


(W/fo)? tan ™(W/fo) 


~ 3[(W/ fo) — tan~!(W/fo)] 


(9.75) 
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Typical values for commercial FM broadcasting are ; 
fo = 2.1 kHz 
W = 15 kHz 


The use of this set of values in Eq. 9.75 yields the result 


I= 4.7 


Expressing the improvement in decibels, we have 
I = 6.7 dB 


The output signal-to-noise ratio of an FM receiver without pre-emphasis 

and de-emphasis is typically 40-50 dB. We thus see that by using the simple 
: pre-emphasis and de-emphasis filters shown in Fig. 9.16, we can obtain a 
3 significant improvement in the noise performance of the receiver. 
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EXERCISE 8 Sketch the power poal no of the esaka i 
noise, assuming that the shape of the power spectral density of the noise — 
at the de-emphasis filter input is as shown in. n Fig. 9, = andi the eam : 
— is as shown in Fig. 9.16). : ; z 


NONLINEAR TECHNIQUES 


The use of the simple linear pre-emphasis and de-emphasis filters described 
herein is an example of how the performance of an FM system may be 
improved by using the differences between characteristics of signals and 
noise in the system. These simple filters also find application in audio tape- 
recording. In recent years nonlinear pre-emphasis and de-emphasis tech- 
niques have been applied successfully to tape-recording. These techniques 
(known as Dolby-A, Dolby-B, Dolby-C, and DBX systems) use a com- 
bination of filtering and dynamic range compression to reduce the effects 
of noise, particularly when the signal level is low.® 


resetea 9.9 DISCUSSION 


We conclude the noise analysis of analog modulation systems by presenting 
a comparison of the relative merits of the different modulation techniques. 
For the purpose of this comparison, we assume that the modulation is 


8For a detailed description of Dolby systems, see Stremler (1982), pp. 671-673. 
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produced by a single sine wave. For the comparison to be meaningful, we 
also assume that all the different modulation systems operate with exactly 
the same channel signal-to-noise ratio. In making the comparison, it is 
informative to keep in mind the transmission bandwidth requirement of 
the modulation system in question. In this regard, we use a normalized 
transmission bandwidth defined by 


B, = — (9.76) 


where B is the transmission bandwidth of the modulated wave and W is 
the message bandwidth. We may thus make the following observations: 


1. In a standard AM system using envelope detection, the output signal- 
to-noise ratio, assuming sinusoidal modulation, is given by (see Eq. 
9.26) 


E 
(SNR)o = 3-53 (SNR)c 


This relation is plotted as curve I in Fig. 9.17, assuming uw = 1. In this 
curve we have also included the AM threshold effect, based on the 
result of Exercise 4. Since in a standard AM system both sidebands are 
transmitted, the normalized transmission bandwidth B,„ equals 2. 

2. In the case of a DSBSC or SSB modulation system using coherent 
detection, the output signal-to-noise ratio is given by (see Eqs. 9.12 and 
9.18): 

(SNR)o = (SNR)c 

This relation is plotted as curve II in Fig. 9.17. We see, therefore, that 
the noise performance of a DSBSC or SSB system, using coherent 
detection, is superior to that of a standard AM system using envelope 
detection by 4.8 dB. It should also be noted that neither the DSBSC 
nor the SSB system exhibits a threshold effect. With regard to trans- 
mission bandwidth requirement, we have B,, = 2 for the DSBSC system 
and B,, = 1 for the SSB system. Thus, among the family of AM systems, 
SSB modulation is optimum with regard to noise performance as well 
as bandwidth conservation. 

3. In an FM system using a conventional discriminator, the output signal- 
to-noise ratio, assuming sinusoidal modulation, is given by (see Eq. 
9.57) 

(SNR)o = 2B°(SNR )c 
where p is the modulation index. This relation is shown as curves III 
and IV in Fig. 9.17, corresponding to 8 = 2 and J = 5, respectively. 
In each case, we have included a 6.7-dB improvement that is typically 
obtained by using pre-emphasis in the transmitter and de-emphasis in 
the receiver. To determine the transmission bandwidth requirement, 
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0 10 20 30 40 50 
Channel signal-to-noise ratio, dB 


Figure 9.17 

Comparison of the noise performance of various analog modulation systems. Curve 
1: Full AM, » = 1. Curve Il: DSBSC, SSB. Curve lll: FM. B = 2. Curve IV: FM. B = 5. 
(Curves lil and IV include 13-dB pre-emphasis, de-emphasis improvement.) 


we use Carson’s rule and thus write 

B, = 6 for f = 2 

B, = 12 for B = 5 
We therefore see that, compared with the SSB system, which is the 
optimum form of linear modulation, by using wideband FM we obtain 
an improvement in output signal-to-noise ratio equal to 14.5 dB for a 
normalized bandwidth B, = 6, and an improvement of 22.6 dB for 
B,, = 12. This clearly illustrates the improvement in noise performance 
that is achievable by using wideband FM. However, the price that we 
have to pay for this improvement is increased transmission bandwidth. 
It is, of course, assumed that the FM system operates above threshold 
for the noise improvement to be realizable as described herein. The 
curves III and IV of Fig. 9.17 include the FM threshold effect, based 
on the results of Exercise 7. Note that the threshold effect in FM man- 
ifests itself at a channel signal-to-noise ratio much greater than that in 
standard AM. 
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PROBLEMS 
P9.1 Signal-to-Noise Ratios 


Problem 1 Consider the sample function of a random process 
x(t) = A + w(t) 


where A is a constant and w(t) is a white noise of zero mean and power 
spectral density No/2. The sample function x(t) is passed through the low- 
pass RC filter shown in Fig. P9.1. Find an expression for the output signal- 
to-noise ratio, with the dc component A regarded as the signal of interest. 


Problem 2 The sample function 
x(t) = A, cos(27f,t) + w(t) 


is applied to the low-pass RC filter of Fig. P9.1. The amplitude A, and 
frequency f. of the sinusoidal components are constants, and w(t) is a 
white noise of zero mean and power spectral density No/2. Find an expres- 
sion for the output signal-to-noise ratio with the sinusoidal component of 
x(t) regarded as the signal of interest. 


Problem 3 Suppose next the sample function x(t) of Problem 2 is applied 
to the band-pass LCR filter of Fig. P9.2, which is tuned to the frequency 
f. of the sinusoidal component. Assume that the Q factor of the filter is 
high compared with unity. Find an expression for the output signal-to-noise 
ratio, by treating the sinusoidal component of x(t) as the signal of interest. 


Problem 4 The input to the low-pass RC filter of Fig. P9.1 consists of a 
white noise of zero mean and power spectral density N)/2, plus a signal 
that is a sequence of constant-amplitude rectangular pulses. The pulse 
amplitude is A, the pulse duration is T, and the period of the sequence is 
Ty, where T < Ty. Derive an expression for the output signal-to-noise ratio 
of the filter, defined as the ratio of the square of the maximum amplitude 
of the output signal with no noise at the input to the average power of the 
output noise. 


Figure P9.1 
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Output 
signal signal 


Figure P9.2 


P9.3 Signal-to-Noise Ratios for Coherent Reception 


Problem 5 Calculate the output signal-to-noise ratio of the coherent re- 
ceiver of Fig. 9.3, assuming that the modulated signal s(t) is produced by 
the sinusoidal modulating wave 


m(t) = A,,cos(27f mt) 
Perform your calculation for the following two receiver types: 
(a) Coherent DSBSC receiver 
(b) Coherent SSB receiver. 


Problem 6 Let a message signal m(t) be transmitted using SSB modu- 
lation. The power spectral density of m(t) is 


Ifl< Ww 
0, otherwise 
where a and W are constants. White noise of zero mean and power spectral 


density Nọ/2 is added to the SSB-modulated wave at the receiver input. 
Find an expression for the output signal-to-noise ratio of the receiver. 


Sy (f) 
watts/Hz 


—400 0 400 f(kHz) 


Figure P9.3 
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Problem 7 An SSB-modulated wave is transmitted over a noisy channel, 
with the power spectral density of the noise being as shown in Fig. Po, 
The message bandwidth is 4 kHz and the carrier frequency is 200 kHz. 
Assuming that only the upper-sideband is transmitted, and that the average 
power of the modulated wave is 10 watts, determine the output signal-to- 
noise ratio of the receiver for the case when the predetection filter char- 
acteristic is ideal. 


P9.4 Noise in AM Receivers Using Envelope Detection 


Problem 8 The average noise power per unit bandwidth measured at the 
front end of an AM receiver is 107° watts per hertz. The modulating wave 
is sinusoidal, with a carrier power of 80 kilowatts and a sideband power 
of 10 kilowatts per sideband. The message bandwidth is 4 kHz. Assuming 
the use of an envelope detector in the receiver, determine the output signal- 
to-noise ratio of the system. By how many decibels is this system inferior 
to a DSBSC modulation system? 


Problem 9 An unmodulated carrier of amplitude A, and frequency f. 
and band-limited white noise are summed and then passed through an ideal 
envelope detector. Assume the noise spectral density to be of height 
N,/2 and bandwidth 2W, centered about the carrier frequency f,. Deter- 
mine the output signal-to-noise ratio for the case when the carrier-to-noise 
ratio is high. 


Problem 10 An AM receiver, operating with a sinusoidal modulating 
wave and 80% modulation, has an output signal-to-noise ratio of 30 dB. 
What is the corresponding carrier-to-noise ratio? 


Problem 11 Consider an AM receiver using a square-law detector with 
output proportional to the square of the input, as indicated in Fig. P9.4. 
The AM wave is defined by 


s(t) = A,f{1 + u cos(2zf,,t)| cos(2zf,t) 


Assume that the additive noise at the detector input is Gaussian with zero 
mean and variance a3; it is defined by 


n(t) = n,(t) cos(2zf,t) — no(t) sin(2z7f,t) 


(a) Show that the output signal-to-noise ratio of the receiver is given 
by 


2u?p? 
SNR S a 
(AB) = T aa 


where p is the carrier-to-noise ratio. 
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Squarer Low-pass 
filter 


Figure P9.4 


(b) Evaluate the asymptotic behavior of (SNR)o with respect to p. 
(c) Plot the dependence of (SNR) on p for the case of 100% modu- 
lation. 


P9.5 FM Receiver Model 


Problem 12 Assume that the FM receiver model of Fig. 9.7a and the 
AM receiver model of Fig. 9.2a have the same additive white noise w(t) 
of zero mean and power spectral density Ny/2. Compare the average noise 
power at the output of the IF filter in Fig. 9.7a with that in Fig. 9.2a. 


P9.6 Noise in FM Reception 


Problem 13 Suppose that the spectrum of a modulating signal occupies 
the frequency band f, = |f| < f,. To accommodate this signal, the receiver 
of an FM system (without pre-emphasis) uses an ideal band-pass filter 
connected to the output of the frequency discriminator; the filter passes 
frequencies in the interval f, < |f| < f,. Determine the output signal-to- 
noise ratio and figure of merit of the system in the presence of additive 
white noise at the receiver input. 


Problem14 An FDM system uses single-sideband modulation to combine 
12 independent voice signals and then uses frequency modulation to trans- 
mit the composite baseband signal. Each voice signal has a power P and 
occupies the frequency band 0.3-3.4 kHz; the system allocates it a band- 
width of 4 kHz. For each voice signal, only the lower sideband is trans- 
mitted. The subcarrier waves used for the first stage of modulation are 
defined by 


c(t) = Ák cos(2zk fot), 0sks11 
The received signal consists of the transmitted FM signal plus white noise 
of zero mean and power spectral density No/2. 


(a) Sketch the power spectral density of the signal produced at the 
frequency discriminator output, showing both the signal and noise com- 


ponents. 
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(b) Find the relationship between the subcarrier amplitudes A, so that 
the modulated voice signals have equal signal-to-noise ratios. 


Problem 15 Consider a phase modulation (PM) system, with the mod- 
ulated wave defined by 


s(t) = A, cos[2zf.t + k,m(t)] 


where k, is a constant and m(t) is the message signal. The additive noise 
n(t) at the phase detector input is 


n(t) = n,(t) cos(2zf,t) — no(t) sin(2zf,t) 


Assuming that the carrier-to-noise ratio at the detector input is high com- 
pared with unity, determine: (a) the output signal-to-noise ratio, and (b) 
the figure of merit of the system. Compare your results with the FM system 
for the case of sinusoidal modulation. 


P9.7 FM Threshold Effect 


Problem 16 ` The results reported in Section 9.7 indicate that the threshold 
point is defined by the carrier-to-noise ratio. 


Ph = 10 


(a) Show that the output signal-to-noise ratio at the threshold point is 
given by 


(SNR Jon = 30 B7(B 1) 


where £ is the modulation index (assuming sinusoidal modulation). 
(b) Find the modulation index £ that produces an output signal-to-noise 
ratio equal to 34.6 dB at the threshold point. Hence, find the corre- 
sponding value of the channel signal-to-noise ratio. 


P9.8 Pre-emphasis and De-emphasis in FM 


Problem 17 By using the pre-emphasis filter shown in Fig. 9.16a and 
with a voice signal as the modulating wave, an FM transmitter produces 
a signal that is essentially frequency-modulated by the lower audio fre- 
quencies and phase-modulated by the higher audio frequencies. Explain 
the reasons for this phenomenon. 


Problem18 A phase modulation (PM) system uses a pair of pre-emphasis 
and de-emphasis filters defined by the transfer functions 


=n a 
PGs) c(i +f 
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and 


Vk 
1 + (jf/fo) 


Half) = 


The constant k is chosen to make the average power of the pre-emphasized 
message equal to that of the original message signal. 


(a) Determine the improvement in output signal-to-noise ratio pro- 
duced by the use of this pair of filters. 

(b) Compare this improvement with that produced in the corresponding 
FM system. 

(c) Given that the message bandwidth W = 15 kHz and the cutoff 
frequency fọ = 2.1 kHz, how do the improvements in SNR for the PM 
and FM systems compare with each other? 
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A basic issue in the design of receivers is that of detecting a weak 
signal embedded in a background of additive noise. Broadly speaking, 
the purpose of detection is to establish the presence or absence of a signal 
in noise. In order to enhance the strength of the signal relative to that of 
the noise, and thereby facilitate the detection process, a detection 
system usually consists of a predetection filter followed by a decision 
device. When the additive noise is white, that is, the power spectral 
density of the noise is constant, it turns out that the optimum solution to 
the predetection filter is a matched filter, which is so-called because its 
characterization is matched to that of the signal component in the 
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received signal. A matched filter is optimum in the sense that it 
maximizes the output signal-to-noise ratio defined in a special way. It is 
thus apparent that a matched filter is useful in the design of digital 
communication systems where the concern is to enhance the received 
pulses so as to maximize the signal-to-noise ratio. In these applications 
we are primarily interested in improving our ability to recognize a pulse 
signal in the presence of additive noise and not in preserving the fidelity 
of the pulse shape. 

In this chapter we study the theory and applications of matched 
filters. We begin the study by formulating the optimum receiver problem. 


10.1 FORMULATION OF THE OPTIMUM RECEIVER PROBLEM 


Consider the situation depicted in Fig. 10.1. Suppose that we have received 
a signal x(t) that consists of either white Gaussian noise w(t) or the noise 
w(t) plus a signal s(t) of known form. The implication of the noise being 
“white” is that its power spectral density has a constant value No/2, say. 
The implication of the noise being “Gaussian” is that a sample drawn from 
such a process has a Gaussian probability distribution for its amplitude. 
We further assume that the noise has zero mean. We wish to estimate 
which of the two hypotheses, noise alone or noise plus signal, is true. We 
do this by operating on the received signal x(t) with a linear time-invariant 
receiver in such a way that if the signal s(t) is present, the receiver output 
at some arbitrary time t = T will be considerably greater than if s(t) is 
absent. 

For example, in a pulse-code modulation system using on-off signaling, 
a pulse s(t) may represent symbol 1, whereas its absence may represent 
symbol 0. We thus have the problem of specifying the input-output relation 
of the receiver according to some criterion, so as to enhance the detection 
process as much as possible. 

We present two approaches to the solution of this basic optimization 
problem. One approach is based on maximization of the signal-to-noise 
ratio at the receiver output. The other approach is based on a probabilistic 
criterion directly related to performance ratings of digital communication 
systems in which we are interested. We will show that: (1) maximization 
of the output signal-to-noise ratio yields the so-called matched filter receiver, 
which involves a filter matched to the signal component of the received 


+ Linear 
s(t) or : i ; 
zero volt ye ca Output 
w(t) 
Figure 10.1 


Processing of noisy signal. 


MAXIMIZATION OF OUTPUT SIGNAL-TO-NOISE RATIO 541 


signal, and (2) the probabilistic approach yields the so-called correlation 
receiver, which involves a correlation of the received signal with a stored 
replica of the transmitted signal. Furthermore, we will show that these two 
receiver structures are indeed equivalent for the case of additive white 
Gaussian noise. 


Berescscesenssseees 10.2 MAXIMIZATION OF OUTPUT SIGNAL-TO-NOISE RATIO 


Consider a linear time-invariant filter of impuse response h(t) or, equiv- 
alently, transfer function H(f), with x(t) as input and y(t) as output. Let 
So(t) and n,(t) denote the signal and noise components of the filter output 
y(t) produced by the signal component s(t) and white noise component 
w(t) of the input, respectively. Since the filter is linear, and the signal s(t) 
and noise w(t) appear additively at the filter input, we may invoke the 
principle of superposition and thus evaluate their effects at the filter output 
by considering them separately. 

Let S(f) denote the Fourier transform of the input signal component 
s(t). Then, the Fourier transform of the corresponding output signal s,(t) 
is equal to H(f)S(f), and s,(t) is itself given by the inverse Fourier trans- 
form: 


s(t) = |” HOSE) expj2nfe) af (10.1) 


Consider next the effect of the noise w(t) alone on the filter output. The 
power spectral density Sy (f) of the output noise n,(t) is equal to the 
power spectral density of the input noise w(t) times the squared magnitude 
of the transfer function H(f) (see Section 8.9). Since w(t) is white with 
constant power spectral density N)/2, it follows that 


Sn (f) = SHE (10.2) 


The average power. of the output noise n,(t) equals the total area under 
the curve of Sy (f). We may therefore write 


A= |" Sn P) af 


==)" HOP af (10.3) 


A simple way of describing the requirement that the filter output be 
considerably greater when the input signal s(t) is present than when s(t) 
is absent, is to ask that, at time t = T, the filter make the instantaneous 
power in the output signal s,(¢) as large as possible compared with the 
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average power in output noise n,(t). This is equivalent to maximizing the 
output signal-to-noise ratio, defined as 


at 10.4 
OO (10.4) 
Using Eqs. 10.2 and 10.3 in 10.4, we get 
r ; 
i H(f)S(f) exp(j2nfT) df 
(SNo = O (10.5) 
> | HCP af 


Our problem is to find, while holding the Fourier transform S(f) of the 
input signal fixed, the form of the transfer function H(f) of the filter that 
makes (SNR)o a maximum. To find the solution to this constrained optimi- 
zation problem, we may apply a mathematical result known as Schwarz’s 
inequality to the numerator of Eq. 10.5. 

We will digress from our task briefly to introduce this important in- 
equality, using a notation consistent with that used herein. 


SCHWARZ’S INEQUALITY 


Consider the complex-valued frequency function H(f)S(f) exp(j2zf T). 
This function may be viewed as the product of two functions, namely, H(f) 
and S(f)exp(j2nfT). Schwarz’s inequality for integrals of complex func- 
tions states that the squared magnitude of the total area under the product 
of two such functions is less than or equal to the product of the total area 
under the squared magnitude of each of the two functions. In mathematical 
terms, Schwarz’s inequality states that! 


< |" HAP af f ISOP af 
(10.6) 


| f HOSH) expi2af) af 


‘Schwarz's inequality, stated in Eq. 10.6 is just an extension of an inequality for real 
functions described by 


2 
f a(t) bit) at | < i a(t) at Í b(t) at 
where a(t) and b(t) denote a pair of real-time functions of finite energy. As such, it 
may be viewed as a generalization of the well-known “distance” relation among 
vectors, which states that the magnitude of the sum of two vectors is less than or 
equal to the sum of the magnitudes of the two vectors. For a formal proof of 
Schwarz’s inequality, see Haykin (1988), pp. 574-76. 
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Here we have used the fact that the exponential term exp(j2zfT) has a 
magnitude of unity; therefore 


IS(f) exp(j2nfT)| = |S(f)| 


Schwarz’s inequality also states that Eq. 10.6 is satisfied with equality if, 
and only if, the first function H(f) is the complex conjugate of the second 
function S(f )exp(j2zf T). This statement is valid to within a scaling factor. 
Let H,,,(f) denote the special value of H(f) that satisfies this condition. 
We may then write 


Hop(f) = S*(f) exp(—j2zfT) (10.7) 


where S*(f) is the complex conjugate of S(f). 

Having equipped ourselves with this new mathematical tool, we are 
ready to resume our task of finding a solution to the optimum receiver 
problem. 


MATCHED FILTER 


Using Schwarz’s inequality of Eq. 10.6 in the formula for the output signal- 
to-noise ratio given in Eq. 10.5, we get 


(SNR)o <5 |” ISOP Af (10.8) 


The right side of this relation does not depend on the transfer function 
H(f) of the filter but only on the signal energy and the noise spectral 
density. Consequently, the output signal-to-noise ratio will be a maximum 
when H(f) is chosen so that the equality holds, that is, 


D fe 
(SNR)oon = z | ISP af (10.9) 


This condition is fulfilled when the transfer function H(f) assumes its 
optimum value H.,,,(f), defined by Eq. 10.7. 

According to Eq. 10.7, except for the exponential factor exp( —j2zfT) 
representing a constant time delay T, the transfer function of the optimum 
filter is the same as the complex conjugate of the spectrum of the input signal. 
Such a filter is called a matched filter. 

Equation 10.7 specifies the matched filter in the frequency domain. To 
characterize it in the time domain, we take the inverse Fourier transform 
of H,,(f) in Eq. 10.7 to obtain the impulse response of the matched filter 
as 


holt) = |” S*(f) expl-j2n f(T = 9] af 
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Figure 10.2 
Matched filter receiver. 


Since for a real-valued signal s(t), we have S*(f) = S(—f), it follows that 


hal) = [7 SCP) expl—j2af(T ~ 9) af 


o) (10.10) 


Equation 10.10 shows that the impulse response of the matched filter’ is a 
time-reversed and delayed version of the input signal s(t). Note that in 
deriving this result the only assumption we have made about the statistics 
of the input noise w(t) is that it is white with zero mean and a power 
spectral density No/2. 

The optimum receiver for detecting the presence of the signal s(t) in 
the received waveform is thus as shown in Fig. 10.2. It consists of a filter 
matched to s(t), a sampler, and a decision-device. At time t = T, the 
matched filter output is sampled and the amplitude of this sample is com- 
pared with a preset threshold 4. If the threshold is exceeded, the receiver 
decides that the known signal s(t) is present; otherwise, it will decide that 
it is absent. The receiver of Fig. 10.2 is called a matched-filter receiver. 

Thus far we have ignored the problem of the physical realizability of a 
matched filter. For a matched filter operating in real time to be physically 
realizable, it must be causal. That is, its impulse response must be zero 
for negative time, as shown by 


hop(t) = 0, t<0 


In terms of Eq. 10-10, the causality condition becomes 


oe Ue t<0 
ba) = 1 ae (10.11) 


*The characterization of a matched filter in terms of its transfer function was first 
derived by North in a classified report (RCA Laboratories Report PTR-6C, June 
1943), which was published 20 years later (North, 1963). For a review of the 
matched filter and its properties, see Turin (1960). 
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If all the input signal s(t) is to contribute to the output signal component 
S,(t), it is apparent from Eq. 10.11 that we must have 


s(t) = 0, G aIr (10.12) 


This relation simply states that all the input signal s(t) must have entered 
the filter by the time t = T at which it is desired to obtain a sample with the 
maximum output signal-to-noise ratio. 

For Eq. 10.11 to be dimensionally correct, the term s(T — t) should be 
multiplied by a scaling factor k that makes the impulse response h,,,(t) of 
the matched filter assume a dimension that is the inverse of time. This has 
the effect of making the transfer function H.,,,(f) of the matched filter in 
Eq. 10.7 dimensionless. We have chosen to ignore the use of such a scaling 
factor merely for convenience of mathematical presentation. 


` EXERCISE 1 Show that multiplication of the optimum transfer function - 
H.,.(f) of Eq. 10.7 by a scaling factor k leaves the maximum signal-to- 
_ noise ratio unchanged. | ; 


asos sssi sss sence 10.3 PROPERTIES OF MATCHED FILTERS 


From the results of the preceding section, we may state that a filter, which 
is matched to an input signal s(t), is characterized in the time domain by 
the impulse response 


ho OSSE i) 


which is a time-reversed and delayed version of the input s(t), as illustrated 
in Fig. 10.3. In the frequency domain, it is characterized by the transfer 
function 


Hop(f) = S*(f) exp(—j2nfT) 


which is, except for a delay factor, the complex conjugate of the spectrum 
of the input s(t). Based on this fundamental pair of relations, we may 
derive some important properties of matched filters, which should help 
you develop an intuitive grasp of how a matched filter operates. 


PROPERTY 1 


The spectrum of the output signal of a matched filter with the matched signal 
as input is, except for a time delay factor, proportional to the energy spectral 
density of the input signal. 
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s(t) 


(a) 


(b) 


Figure 10.3 
(a) Input signal. (b) Impulse response of matched filter. 


Let S,(f) denote the Fourier transform of the filter output s(t). Then, 


SAF) = Hal PSF) 
= S*(f)S(f) exp(—j2afT) 
= |S(f)P exp(—j2zfT) (10.13) 


This is the desired result, since |S(f)|? is the energy spectral density of the 
input signal s(t). 


OOOO OOOO ETOE SEE EOE OTTESSLE SESE TESOL SO SHOOT SO CEOTEOOTSOETESOOEHSSESSOESSODOSSOSEOSSOSOOOOOOSOOOOSS ESOT TESOESOEODSSOOCEOCETOS 


EXAMPLE 1 MATCHED FILTER FOR A RECTANGULAR PULSE 


Consider a rectangular pulse s(t) of duration T and amplitude A, as in Fig. 
10.4a: 


A, Qst=sxT 
SCE) = { (10.14) 


0, otherwise 


For convenience of presentation, we assume that the pulse s(t) has unit 
area; that is AT = 1. Then, the Fourier transform of s(t) is 


S(f) = sinc(fT) exp(—jxfT) 
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s(t) 


A 


(b) 


Figure 10.4 
(a) Rectangular pulse input. (b) Matched filter output, assuming AT = 1. 


The impulse response of a filter matched to the rectangular pulse s(t) 
is also a rectangular pulse, as shown by 


A, O<xt<xT 
holt) = l (10.15) 


0, otherwise 


The transfer function of this matched filter is (assuming AT = 1) 
Hot) = sinc(f T) exp(-jnfT) (10.16) 


which, in this example, is the same as S(f). The Fourier transform of the 
matched filter output is therefore 


S) = Hal PSF) 
sinc?(f T) exp(—j2nfT) 


The factor sinc’(f T) is recognized as the energy spectral density of the 
rectangular pulse s(t), assumed to be of unit area. Thus, §,(f) is in accord 
with Property 1. 


Oe errr irr irri errr reer rrr rire rr errrr ree errrrrrrer rrr err 


PROPERTY 2 


The output signal of a matched filter is proportional to a shifted version of 
the autocorrelation function of the input signal to which the filter is matched. 
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This property follows directly from Property 1, recognizing that the au- 
tocorrelation function and energy spectral density of a signal form a Fourier 
transform pair (see Section 4.2). Thus, taking the inverse Fourier transform 
of Eq. 10.13, we may express the matched-filter output as 


So(t) = ted) (10.17) 


where R,(t) is the autocorrelation function of the input s(¢) for time lag 
t. Equation 10.17 is the desired result. 


a EXERCISE 2. Consider a filter matched to an energy signal s(t) of duration 
` T seconds. The filter is excited by an input that consists of a delayed version 
` of the signal s(t); the delay equals to seconds. 


(a) What is the time at which the filter output attains its maximum 
value? 
(b) What is the maximum value of the filter output? 


Meee eC COTO HOES OOO ASESOODESOT SO OEHE EEE OES OE SEES SOUS SSE SESESSSESEESEOOST SOO SSESESETE ESOS SEES SSO OOS SETEESEOSSSOSSHOSSESSE SESS 


EXAMPLE 2 MATCHED FILTER FOR A 
RECTANGULAR PULSE (CONTINUED) 


Consider again the matched filter for the rectangular pulse s(t) of amplitude 
A and duration T, as shown in Fig. 10.4a. The rectangular pulse s(t) is 
defined in Eq. 10.14, and the impulse response h,,,(t) of the corresponding 
matched filter is defined in Eq. 10.15. Convolving s(t) with h,,,(t), we find 
that the matched filter output s,(t) has a triangular waveform. Specifically, 
for AT = 1 we have 


—, 0<t<T 
ig 

s(t) = (2-4), Tet <= 2T 
0, otherwise 


This waveform is plotted in Fig. 10.46, which is recognized as the auto- 
correlation function of the rectangular pulse s(t), shifted by T seconds. 
Note that the matched filter output s,(t) attains its maximum value at time 
t = T, and that its duration is twice that of the input signal. 
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EXERCISE 3 Consider an RF pulse s(t) of amplitude A, duration T, N 
frequency f., as shown in Fig. 10.5a. The frequency f, is an integer multiple 
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(6) 


Figure 10.5 
(a) RF pulse input. (b) Matched filter output, assuming AT = 2. 


of 1/T, and large enough for the RF pulse s(t) to be treated as a narrow- 
band signal. 


(a) Show that the matched filter output s,(t) is defined by 


= cos(27f,t), 0<t=<T 


S(t) = t 
A{2 — T cos(27f .t), Tst<2T 


Go otherwise 
where, for convenience, it is assumed that AT = 2. 


(b) Verify that the matched filter output s,(¢) has the waveform shown 
in Fig. 10.55. 
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EXAMPLE 3 MATCHED FILTER PAIR 


A possible exploitation of property 2 of a matched filter is illustrated in 
Fig. 10.6. Let us suppose that we have a signal s(t), lasting from t = 0 to 
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Sees weccccevevcessooscessne 


COS e eee SoSH eS OSEHH SEA EHSSSOEOOSOSOSESSSCOSEOSSSOSSOSOESTETOSSCSSSEODESEEES 


LITE CCC rirrrr rrr rrr Tir r rrr Try 


550 OPTIMUM RECEIVERS FOR DATA COMMUNICATION 


Filter of 
impulse 
response 
s(t) 


Matched 
filter 


Output 
Short yi) 
input 
pulse 


w(t) 


Figure 10.6 l 
Viewing the matched filtering operation as an encoding-decoding process. 


= T, which has the appearance and character of a sample function of a 
random process with a broad power spectral density, so that its autocor- 
relation function approximates a delta function. This signal may be gen- 
erated by applying, at ¢ = 0, a short pulse (short enough to approximate 
a delta function) to a linear filter with impulse response s(t). The impulse- 
like input signal has components occupying a very wide frequency band, 
but their amplitudes and phases are such that they add constructively only 
at and near ¢ = 0 and cancel each other out elsewhere. We may therefore 
view the signal-generating filter as an encoder, whereby the amplitudes 
and phases of the frequency components of the impulse-like input signal 
are coded in such a way that the filter output becomes noise-like in char- 
acter, lasting from ¢ = 0 tot = T, asin Fig. 10.7a. The signal s(t) generated 
in this way is to be transmitted to a receiver via a distortionless but noisy 
channel. The requirement is to reconstruct at the receiver output a signal 
that closely approximates the original impulse-like signal. 

The optimum solution to such a requirement, in the presence of additive 
white Gaussian noise, is to employ a matched filter in the receiver, as in 
Fig. 10.6. We may view this matched filter as a decoder, whereby the useful 
signal component s(t) of the receiver input is decoded in such a way that 
all frequency components at the filter output have zero phase at t = T, 
and add constructively to produce a large pulse of nonzero width, as in 
Fig. 10.76. Thus, in coding the impulse-like signal at the transmitter input 
we have spread the signal energy out over a duration T, and in decoding 
the noise-like signal at the receiver input we are able to concentrate this 
energy into a relatively narrow pulse. The extent to which the receiver 
output s,(¢) approximates the original impulse-like signal is simply a re- 
flection of the extent to which the autocorrelation function of the trans- 
mitted signal s(¢) approximates a delta function. The signal generating and 
reconstruction filters in Fig. 10.6 are said to constitute a matched-filter pair. 

The idea of a matched filter pair is basic to a secure communication 
technique known as spread spectrum modulation.’ In this method of mod- 
ulation, the noise-like character of the transmitted signal is produced by 
having an information-bearing binary sequence modulate a bandwidth- 


*For an introductory discussion of spread spectrum modulation, see Haykin (1988), 
pp. 445-73. 
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s(t) 


(a) 


(b) 


Figure 10.7 
{a) Noise-like input signal. (b) Matched filter output. 


spreading sequence that acts as a carrier, and the information-bearing se- 
quence is recovered at the receiver by means of a filter matched to the 
spreading sequence employed in the transmitter. In a popular type of spread 
spectrum modulation, a pseudonoise (PN) sequence is used as the spreading 
sequence, and each block of pulses constituting a period of the PN sequence 
is multiplied in the transmitter by +1 or —1, depending on whether the 
particular binary symbol of the information-bearing sequence is a 1 or a 
0. The receiver uses a filter matched to the PN sequence employed in the 
transmitter. From Chapter 8 we recall that the autocorrelation function of 
a PN sequence (also known as a maximal length sequence) consists of a 
periodic train of short triangular pulses that have the appearance of an 
impulse; see Fig. 8.21a. Hence, the matched filter output due to the in- 
formation-bearing sequence consists of a periodic train of short triangular 
pulses, with the polarity of each pulse being determined by the identity of 
the corresponding binary symbol of the information-bearing sequence. On 
the other hand, an interfering (jamming) signal, unmatched to the PN 
sequence, is rejected by the matched filter receiver. The level of this re- 
jection is determined by the ratio T,/T., where T, is the bit duration of 
the information-bearing sequence, and T, is the duration of a basic pulse 
of the PN sequence; the ratio T,/T., expressed in decibels, is called the 
processing gain of the system. Hence, by assigning a large value (on the 
order of 1000) to this ratio, a secure communication link is established 
between the transmitter and the receiver. Moreover, the 1’s and 0’s of the 
original information-bearing sequence are detected by sampling the matched 
filter output every T, seconds: If the polarity of a sample under test is 
positive, a decision is made in favor of symbol 1; otherwise, a decision 1s 
made in favor of symbol 0. | 
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PROPERTY 3 


The output signal-to-noise ratio of a matched filter depends only on the ratio 
of the signal energy to the power spectral density of the white noise at the 
filter input. 


This property follows directly from Eq. 10.9, reproduced here for con- 
venience 


(SNR)oon = 5 [__ ISCAP af 


where S(f) is the Fourier transform of the signal s(t) to which the filter 
of interest is matched. From Rayleigh’s energy theorem, the signal energy 
E is given by 


E= |" e@de= f |S(NP af 


Accordingly, we may rewrite the expression for the output signal-to-noise 
ratio of the matched filter as 


2E 


(SNR oop: = N, (10.18) 


which is the desired result. 

Equation 10.18 is perhaps the most important result in the evaluation 
of the performance of signal processing systems using matched filters. From 
Eq. 10.18 we see that. dependence on the waveform of the input s(t) has 
been completely removed by the matched filter. Accordingly, in evaluating 
the ability of a matched-filter receiver to combat white Gaussian noise, we 
find that all signals that have the same energy are equally effective. Note 
that the signal energy E is in joules and the noise spectral density No/2 is 
in watts per hertz, so that the ratio 2E/N, is dimensionless; however, the 
two quantities have different physical meaning. 


EXERCISE 4 Consider a rectangular pulse of amplitude A and duration 
T. Show that the output signal-to-noise ratio of a filter matched to this ` 
pulse is ? m o 
2AT 
(SNR)o =- (10.19) 
No a 
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PROPERTY 4 


The matched-filtering operation may be separated into two matching con- 
ditions; namely, spectral phase matching that produces the desired output 
peak at time T, and spectral amplitude matching that maximizes the output 
signal-to-noise ratio at time t = T. 


In polar form, the spectrum of the signal s(t) being matched may be 
expressed as 


SC(F) = [S(f)| explia(f)] 


where |S(f)| is the amplitude spectrum and 6(f) is the phase spectrum of 
the signal. The filter is said to be spectral phase matched to the signal s(t) 
if the transfer function of the filter is defined by‘ 


H(f) = |H(f)| exp[—j0(f) — j2nfT] 


where |H(f)| is real and nonnegative. The output of such a filter is 
s(t) = |” HASH) exp(i2nfe) df 
= |" HIIS expLi2nfe - T) af 


where the product |H(f)||S(f)| is real and nonnegative. The spectral phase 
matching ensures that all the spectral components of the output s¿(t) add 
constructively at time £ = T, thereby causing the output to attain its max- 
imum value, as shown by 


s(t) < 857) = |” ISOH) af 


For spectral amplitude matching, we choose the amplitude response |H(f)| 
of the filter to maximize the output signal-to-noise ratio at £ = T by using 


IAA] = ISA 


and the standard matched filter is the result. 


10.4 APPROXIMATIONS IN MATCHED FILTER DESIGN 


In considering the design of a matched filter, we have to take account of 
two aspects of the problem—physical realizability and practical feasibility. 


‘Birdsall (1976). 
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For a matched filter operating in real time to be physically realizable, its 
impulse response must be zero for negative time. In Section 10.2 we showed 
that if the signal s(t) to which the filter is to be matched lasts from ¢ = 0 
to t = T, then the physical realizability requirement is satisfied by intro- 
ducing a finite delay, equal to T, in the impulse response of the filter. 
Then, of course, we must wait until time ¢ = T for the output signal 
component s(t) of the matched filter to reach its peak value s,(7). In 
other words, we cannot expect the output signal component s,(¢) to contain 
the full information about the input signal s(t) until the signal has been 
fully received by the filter. Suppose, however, that the signal duration T 
is too large and we cannot afford to wait until time £ = T before extracting 
information about the signal s(t). Then, in order to maximize the output 
signal-to-noise ratio at some instant t = T', where T’ < T, we should use 
the part of the optimum impulse response h,,,(t) that extends from t = 0, 
to t = T’, and delete the remainder. The resulting output signal-to-noise 
ratio, measured at time t = T’, is still of the form of Eq. 10.18 except 
that now E must be interpreted not as the total signal energy, but rather 
as that part of the signal energy having been received by the filter at time 
t = T'. Obviously, in such a case, we are no longer dealing with a true 
matched filter, but rather an approximation to it, with the nature of the 
approximation determined by what fraction of the signal energy is received 


by time ¢ = T”. 


Another problem encountered in the construction of a matched filter is 
that it is often difficult to realize a filter with a transfer function exactly 
equal to the complex conjugate of the spectrum of the input signal s(¢). 
We may, then, have to apply some form of approximation to the optimum 
transfer function H,,,( f ) in order to arrive at a practical realization. Such 
an approximation results in some loss in performance compared with a 
true matched filter. This procedure is best illustrated by examples. 


EXAMPLE 4 APPROXIMATIONS FOR A MATCHED 
FILTER FOR A RECTANGULAR PULSE 


Consider again the rectangular pulse s(t) of Fig. 10.4a. The pulse has 
amplitude A and duration T; let AT = 1 for convenience of presentation. 
In this example, we examine two different low-pass structures for approx- 
imating the matched filter for this rectangular pulse. The two structures 
are an ideal low-pass filter and an RC low-pass filter, which are considered 


in turn. 


1. Ideal low-pass filter with variable bandwidth: The transfer function 
H.»:( f) of the matched filter of interest is given in Eq. 10.16, which is 


reproduced here for convenience: 


HopA f) 


= sinc(f T) exp(—jzfT) 
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The amplitude response |H_,,,(f)| of the matched filter is plotted in Fig. 
10.8a. We wish to approximate this amplitude response with an ideal low- 
pass filter of bandwidth B. The amplitude response of this approximating 
filter is shown in Fig. 10.86. The requirement is to determine the particular 
value of bandwidth B that will provide the best approximation to the 
matched filter. 

From Example 4 of Chapter 3, we recall that the maximum value of the 
output signal, produced by an ideal low-pass filter in response to the rec- 
tangular pulse of Fig. 10.4a, occurs at t = T/2 for BT < 1. This maximum 
value, expressed in terms of the sine integral, is equal to (2A/z)Si(zBT). 
The average noise power at the output of the ideal low-pass filter is equal 
to BNo. The maximum output signal-to-noise ratio of the ideal low-pass 
filter is therefore 


_ QA/n) S?(aBT) 


(SNR )o BN, 


(10.20) 


Thus, using Eqs. 10.19 and 10.20, and assuming that AT = 1, we get 


(SNR) 2 Ț 
Ce e) 


|Hopt P) 
1.0 
e e 
i (a) i 
|H(f)| 
1.0 
f 
-B 0 B 
(b) 


Figure 10.8 i 
(a) Amplitude response of a filter matched to a rectangular pulse. (b) Amplitude 
response of an ideal low-pass filter approximating the matched filter. 


556 OPTIMUM RECEIVERS FOR DATA COMMUNICATION 


Matched filter 


Ideal low-pass 
2c a ee filter 


RC 
low-pass 
filter 


0 0.2 04 0.685 1.0 


Figure 10.9 
The effect of varying the time-bandwidth product BT on the output signal-to-noise 
ratio of an ideal low-pass filter and that of RC low-pass filter. 


This ratio is plotted in Fig. 10.9 as a function of the time-bandwidth product 
BT. The peak value on this curve occurs for BT = 0.685, for which we 
find that the maximum signal-to-noise ratio of the ideal low-pass filter is 
0.84 dB below that of the true matched filter. Therefore, the “best” value 
for the bandwidth of the ideal low-pass filter characteristic of Fig. 10.8b 
is B = 0.685/T. 

2. RC Low-pass filter of variable bandwidth: Consider next the simple 
RC low-pass filter shown in Fig. 10.10a, which is required to provide the 
best approximation to the matched filter for a rectangular pulse s(t) of 
amplitude A and duration T. In this case, it is easiest to do the analysis in 
the time domain. To proceed, the pulse s(t) is reproduced in Fig. 10.105. 
The response (output) of the filter to the input pulse s(t) is plotted in Fig. 
10.10c. Comparing the RC low-pass filter output s(t) in Fig. 10.10c with 
the matched filter output s,(t) shown in Fig. 10.45, we see that they have 
somewhat similar waveforms. 

The response s,(t) of the RC low-pass filter reaches its peak value at 
time t = T, which is given by 


T 
D SPAAN = —- — : 
Sah) | | x) | (10.21) 
where RC is the time constant of the filter. The 3-dB bandwidth B of the 


filter is related to the time constant RC by 


1 
as 2nRC 
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(b) 


(c) 


Figure 10.10 3 
(a) RC low-pass filter. (b) Rectangular pulse input. (c) Response of the filter. 


We may therefore rewrite Eq. 10.21 in terms of the bandwidth B as 
si(T) = A[1 — exp(—2zBT)] (10.22) 


Our next task is to calculate the average power at the RC low-pass filter 
output produced in response to a white noise input of zero mean and power 
spectral density No/2. The transfer function of the filter is 


1 

OO. ARC 
1 

= 1 + (jf/B) 


558 OPTIMUM RECEIVERS FOR DATA COMMUNICATION 


Hence, the average noise power at the low-pass filter output is 


Hs = [SIH af 
: _ No [* df 
© 2 J_21 + (f/BY 
_ nNoB 
ar aa (10.23) 


We may now use Eqs. 10.22 and 10.23 to calculate the output signal- 
to-noise ratio of the RC low-pass filter in Fig. 10.10a at time t = T; the 
result is 


2AF 
5 = l i expl BT] 10.24 
(SNR) = = [1 — exp(-2z8T)] (10.24) 


Thus, using Eqs. 10.19 and 10.24, we get 


a = = [1 — exp(-2nBT)P 


This dimensionless ratio is plotted versus the time-bandwidth product BT 
in Fig. 10.9. The curve reaches a peak value of 0.816 at BT = 0.2. There- 
fore, the maximum output signal-to-noise ratio of the RC low-pass filter 
is only 0.9 dB below that of the actual matched filter. 

It is noteworthy to compare the ideal and RC low-pass filters as ap- 
proximate realizations of the matched filter for a rectangular pulse. Despite 
its simplicity, the RC low-pass filter is worse than the ideal low-pass filter 
by only 0.06 dB; this degradation in performance is small enough to be 
ignored in practice. Accordingly, the RC low-pass filter is the preferred 
solution. 
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Dogoni 10.5 PROBABILISTIC APPROACH 


The filter optimization criterion based on maximization of the output signal- 
to-noise ratio, described in Section 10.2, has the advantage of requiring 
knowledge of only the power spectral density of the noise w(t) at the 
receiver input. Although such a criterion has a strong intuitive justification, 
nevertheless, we should prefer to use criteria directly related to probabi- 
listic performance ratings of the system under study. For example, in a 
pulse-code modulation system with on-off signaling, symbol 1 is repre- 
sented by the presence of a pulse s(t), whereas symbol 0 is represented by 
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the absence of the pulse. The presence of noise at the front end of the 
receiver causes two kinds of error to arise: 


1. An error that occurs when symbol 0 is transmitted and the receiver 
decides in favor of symbol 1. 


2. An error that occurs when symbol 1 is transmitted and the receiver 
decides in favor of symbol 0. 


For a choice of criterion to optimize the performance of this system, we 
may wish to minimize the average probability of error involving both kinds 
of error. This brings us into the realm of classic statistical hypothesis-testing 
procedures. 


LIKELIHOOD RATIO 


In the simplest hypothesis-testing problem, the observed signal x(t) is either 
due solely to white Gaussian noise w(t) of zero mean and power spectral 
density No/2, which constitutes the null hypothesis, or due to both an 
exactly known signal s(t) and noise w(t), which constitutes the alternative 
hypothesis. Denoting the null hypothesis as Hy and the alternative hy- 
pothesis as H,, we may write: 


Hy: x(t) = w(t) (10.25) 
Hy: x(t) = s(t) + w(t) 
The problem is to observe the received signal x(t) over an interval from 
zero to T seconds and then decide whether Hy or H, is true, according to 
some criterion. 

To get a probabilistic description of the continuous received signal x(t), 
we first assume that m amplitude samples of x(t) are available, and then 
take the limit as m approaches infinity. At time tį, we thus have 


pe ele (10.26) 
HH Xk = Sk t Wk 

where x+, Sx, and w, refer to sample values of x(t), s(t), and w(t) at time 

ty, respectively; the time index k = 1,2,...,m. We may then define an 

m-by-1 observation vector x that consists of the sample values x,,x2,..., 

Xm, as Shown by 
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The vector x represents a single realization of the signal observed (mea- 
sured) at the receiver input. Let the random vector X denote the ensemble 
of all such realizations; naturally, the randomness arises because of the 
additive white Gaussian noise at the receiver input. 

Let f (x) denote the conditional probability density function of the 
random vector X given that Ho is true, and let f,(x) denote the conditional 
probability density function of X given that H, is true.” These two con- 
ditional probability density functions are basic to the probabilistic approach 
to receiver design. 

In the binary hypothesis-testing problem, we know that either Hy or H, 
is true. Thus, assuming that a choice has to be made each time the ex- 
periment is conducted, one of four things can happen: 


1. His true: choose Ho. 
2. H, is true: choose H,. 
3. H, is true: choose H,. 
4. H, is true: choose Ho. 


It is apparent that alternatives (1) and (3) correspond to correct choices, 
whereas alternatives (2) and (4) correspond to errors. The purpose of a 
decision rule is to attach some relative importance to the four possible 
courses of action. To implement the decision rule, we divide the total 
observation space Z into two parts, Zọ and Z,. In particular, when an 
observation falls in Z) we choose hypothesis Ho, and when an observation 
falls in Z, we choose hypotheses H,. Accordingly, we may identify two 
important probabilities: 


1. The conditional probability of correct reception, defined as the m-fold 
integral 


f feo ax, evo 


where the m-dimensional decision region Z; corresponds to hypothesis 
H;. 
2. The conditional probability of error, defined as the m-fold integral 


ip f(x) dx, i=0,1. 


‘According to the notation described in Chapter 8, the conditional probability 

density function of the random vector X, given that hypothesis H, is true, is written 
as fx(x|Hp). In the material presented herein, the notation is simplified by denoting 
this conditional probability density function as f (x). Similar remarks hold for f(x). 
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where Z, denotes “the not Z,” decision region; that is, 


ae i 
an E i 


0 
il 


In a digital communication system, we are specifically interested in min- 
imizing the average probability of error. Let p and q denote the a priori 
probabilities of hypotheses H) and H,, respectively. These probabilities 
represent the observer’s information about the source that generates the 
observation vector x before the experiment is conducted. Then, we may 
express the average probability of error as 


Pe, i: Rimes bg Í Po (10.27) 


On the right side of Eq. 10.27, the first integral represents the conditional 
probability of an error of the first kind, and the second integral represents 
the conditional probability of an error of the second kind. Since the total 
observation space Z = Zo + Z,, we may rewrite Eq. 10.27 as 


P=p|  folxydx+q] file) ax (10.28) 


We note, however, that the probability of an observation falling in the 
total observation space Z is equal to 1, because it is a certain event; that 
iS, 


foo) ax = 1 
Z 
Hence, we may simplify Eq. 10.28 as 
P. =p + | [afi(x) - pfols)] dx (10.29) 
Zo 


On the right side of Eq. 10.29 the first term is fixed whereas the integral 
represents the error probability controlled by those points x that we assign 
to Zo. Therefore, all values of x for which pfo(x) is greater than qf,(x) 
should be assigned to Zo because they contribute a negative amount to the 
integral. Similarly, all values of x for which the reverse is true should be 
assigned to Z; (i.e., excluded from Zo) because they would contribute a 
positive amount to the integral. Values of x where the two terms are equal 


562 OPTIMUM RECEIVERS FOR DATA COMMUNICATION 


have no effect on the average probability of error P, and may be assigned 
arbitrarily. We will assume that such points are assigned to Z). We may 
thus define the decision regions as 


If gf (x) is greater than pf (x), 
assign x to Z; and accordingly choose hypothesis H,. 
Otherwise, assign x to Zo and choose hypothesis Hj. ` (10.30) 


Equivalently, we may write 


se 0.31 
folx) me 4 aa 


The quantity on the left side of Eq. 10.31 is called the likelihood ratio. 
Denoting this ratio by A(x), we have 


A(x) = ae (10.32) 


Note that since the likelihood ratio A(x) is a ratio of two functions of a 
random variable, it is itself a random variable. However, regardless of the 
dimensionality of x, the likelihood ratio 4(x) is a one-dimensional random 
variable. In terms of 4(x), we may thus rewrite Eq. 10.31 simply as 


Hı p 
A(x) 22 (10.33) 
Ho q 


This test is called the minimum probability of error criterion.® 
Since the natural logarithm is a monotonic function, and both sides of 
Eq. 10.33 are positive, it follows that an equivalent test is 


Ind (x) 2 in(2) (10.34) 


‘Equation 10.33 is a special case of the Bayes’ test: 
Hy 


A(x) 27 
Ho 


where 7 is called the threshold of the test. According to the Bayes’ test, the 

threshold 7 is determined by two sets of factors: (a) the a priori probabilities p and 
q, and (b) the individual costs assigned to the four possible outcomes of the binary 
hypothesis testing problem. For a detailed treatment of Bayes’ test and related 
ree see the following references: van Trees (1968), Helstrom (1968), and Whalen 
1971). 
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Choose H, if 


Log- 
In A (x) > In(Z ) 


likelihood 
ratio 
computer 


Otherwise, choose H) 


Threshold 
In(g) 


Figure 10.11 
Likelihood ratio receiver. 


We refer to InA(x) as the log-likelihood ratio. When the two hypotheses 
Ho and H; are equally likely (1.e., p = q), the decision level against which 
the log-likelihood ratio is compared is zero. This assumption is usually true 
in digital communications. 

The optimum receiver based on Eq. 10.34 is known as the likelihood 
ratio receiver, shown in Fig. 10.11. We see that all the data processing 
required for the test is involved in computing the log-likelihood ratio InA(x), 
based on the observation vector x, and it is not affected by the a priori 
probabilities p and q. This invariance property of the likelihood ratio test 
is of considerable practical importance. The values of the a priori proba- 
bilities affect only the decision level. This means that we can construct a 
processor based only on the log-likelihood ratio and accommodate any 
subsequent changes in our estimates of the a priori probabilities, if ever 
required, by simply varying the decision level. 


EXERCISE 5 Justify the statement that the likelihood ratio A(x) and the 
ratio p/q are both positive. 


CORRELATION RECEIVER 


Let us momentarily assume that the noise is band-limited white Gaussian 
noise with power spectral density: 


No 
Sw(f) = 4 2” fl<B (10.35) 
0, f| >B 


If the signal x(t) containing such a noise (as an additive component) is 
sampled with sampling interval T, = 1/2B, the samples are uncorrelated, 
and being Gaussian, they are statistically independent. In the observation 
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interval from zero to T, we collect a total of m = T/T, = 2BT statistically 
independent samples. The joint-probability density functions fo(x) and 
fi(x) are therefore the products of probability density functions of the 
individual components of the random vector X, assuming that Ho and H, 
are true, respectively. 

To explicitly write fo(x) or fı(x), we must have the mean and variance 
of the random variables X,, k = 1,..., m, which constitute the random 
vector X. Since the noise w(t) has zero mean, we have 


Hy: mean of X, = 0 
H,: mean of X; = S, ` (10.36) 


where s, is the value of the signal s(t) at time t,. The variance of X, is the 
same under both H, and H,, as shown by 


a°(X;,) = o°(W,) = o? (10.37) 


where W, is the random variable obtained by observing the band-limited 
white noise process w(t) at time tą. The variance a’ is simply that of the 
noise component: 


No 
oT, 


o? = NB = (10.38) 


The equality o? = NoB follows from the fact that the average noise power 
(represented by a”) equals the total area under its power spectral density 
curve. We may therefore express the conditional probability density func- 
tion f(x) as 


Ha) = i fæ) 


where 


Hence, we have 


fo(x) = aT exp( - > a) (10.39) 


Similarly, we may write 


1 A (Xe = Si) 
fix) = Ono)? exp| - » | (10.40) 
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Substituting Eqs. 10.39 and 10.40 in 10.34, and simplifying, we get 


iMs 


il ced p 
a 2 E Ss l -a 
20? aL Dirk Se) A n(2) 


or, equivalently, 
H; EO ce 
Ske X lo s 
-en D 10.41 
i o? Ho : + 2 È g ( ) 


From Eq. 10.38, the variance g? of the noise is equal to No/2T,. Therefore, 
substituting this value for o* in Eq. 10.41, we get 


m Hı 1 m 
= Dy rl, = = in(2) ie S) iT, (10.42) 


0 k=1 


The decision rule in Eq. 10.42 is expressed in terms of m uniformly 
spaced samples of the received signal x(t) and of the known signal s(t). 
To obtain the corresponding decision rule in terms of the continuous func- 
tions x(t) and s(t), we allow the sampling interval T, to approach zero and 
m (and therefore B) to approach infinity in such a way that the observation 
interval mT, remains a constant, T. In the limit, the summations in Eq. 
10.42 become integrals, yielding 


Ea ioe m(2) T | ” $28) de (10.43) 
mal aie m q No Jo i 
Equivalently, we may write 
T ~ M 
| OnOr A (10.44) 
0 Ho 
where A is a new threshold defined by 
T 
ae m(2) J | s(t) dt (10.45) 
2 q 2 Jo 
We also note that 


ne [20 dt 
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is the energy of the known signal s(t). That is, the threshold 4 in the test 
described by Eq. 10.44 depends on the a priori probabilities p and q, the 
noise spectral density No, and the signal energy E; see Eq. 10.45. 


] EXERCISE 6 Discuss the ways in which the threshold Ais affected by the 
following values of a priori p probabilities: 


(a) Symbols 0 and 1 occur with equal probability. 
(b) Symbol 0 occurs twice as frequently as symbol 1. 
-O Symbol 1 occurs twice as frequently as symbol 0. 


IMPLEMENTATION CONSIDERATIONS 


The decision rule described by Eq. 10.44 may be implemented as shown 
in Fig. 10.12. This receiver is called a correlation receiver.” It correlates the 
received signal x(t) with a stored replica of the known signal s(t). If the 
correlator output is larger than the predetermined threshold 4, we choose 
H; otherwise, we choose Ho. 

Consider the integral term on the left side of Eq. 10.43. Substituting 
the time difference T — 1 for ¢ in this integral, we have 


[sox m fsa e amie 


Il 


ines =C = ae 


However, from Eq. 10.10, we note that s(T — t) is simply the impulse 
response h,,,(¢) of a linear time-invariant filter matched to the known signal 
s(t). Therefore, 


| Ona | naa (10.46) 


The term on the right side of Eq. 10.46 is the output of a matched filter 
of impulse response h,,,(t) due to an input x(t), evaluated at time T. This 
means that the matched-filter receiver of Fig. 10.2 and the correlation receiver 
of Fig. 10.12 are equivalent. That a criterion based on maximization of the 
output signal-to-noise ratio and a probabilistic criterion should lead to 
exactly the same result in the case of additive white Gaussian noise is no 
coincidence; indeed, it is testimony to the intimate connection between 


"The derivation of the correlation receiver using a probabilistic criterion is 
historically credited to Woodward (1964). 
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Choose H, if 
À is exceeded 
x(t) ecision 
de 
eer Otherwise, 
choose Ho 


s(t) À 


Figure 10.12 
Correlation receiver. 


the two types of criteria in this special case. Note, however, that the 
correlator output in Fig. 10.12 and the matched-filter output in Fig. 10.2 
are equivalent only at time T. 


conconencenasononce 10.6 PROBABILITY OF ERROR FOR BINARY PCM 


As an application of the binary hypothesis-testing procedure described by 
Eq. 10.44, we consider the performance of a binary PCM system in the 
presence of channel noise; the receiver is depicted in Fig. 10.12. We do 
so by evaluating the average probability of error for such a system under 
the following assumptions: 


1. The PCM system uses an on-off format, in which symbol 1 is represented 
by A volts and symbol 0 by zero volt. 

2. The symbols 1 and 0 occur with equal probability. 

3. The channel noise w(t) is white and Gaussian with zero mean and power 
spectral density No/2. 


To determine the average probability of error, we consider the two 
possible kinds of error separately. We begin by considering the first kind 
of error that occurs when symbol 0 is sent and the receiver chooses symbol 
1. In this case, the probability of error is just the probability that the 
correlator output in Fig. 10.12 will exceed the threshold 4 owing to the 
presence of noise, so the transmitted symbol 0 is mistaken for symbol 1. 
Since the a priori probabilities of symbols 1 and 0 are equal, we have 
p = q. Correspondingly, the expression for the threshold 4 given in Eq. 
10.45 simplifies as follows 


A= (10.47) 


where T, is the bit duration, and A’T, is the signal energy consumed in 
the transmission of symbol 1. Let y denote the correlator output: 


ne i * s()x(O) de (10.48) 
0 
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Under hypothesis Hy, corresponding to the transmission of symbol 0, the 
received signal x(t) equals the channel noise w(t). Under this hypothesis 
we may therefore describe the correlator output as 


MSA | W(t) dt (10.49) 
0 


Since the white noise w(t) has zero mean, the correlator output under 
hypothesis Hy also has zero mean. In such a situation, we speak of a 
conditional mean, which (for the situation at hand) we describe by writing 


E e| i ” w(t) a a (10.50) 


where the random variable Y represents the correlator output with y as its 
sample value and W(t) is a white-noise process with w(t) as its sample 
function. The subscript 0 in the conditional mean mp refers to the condition 
that hypothesis H, is true. Correspondingly, let § denote the conditional 
variance of the correlator output, given that hypothesis Ho is true. We may 
therefore write 


E(Y*\Ho] 
Us RT 

e| i | W(t.) W(t) dt, a, (10.51) 
0 0 

The double integration in Eq. 10.51 accounts for the squaring of the cor- 


relator output. Interchanging the order of integration and expectation in 
Eq. 10.51, we may write 


a 
© 
ll 


o = |" |” ELWO)W()) dt di 
0 
T, [Te 
-Í | Ry(t, — tz) dt, dt, (10.52) 
0 0 


The parameter Ry(t, — t,) is the ensemble-averaged autocorrelation func- 
tion of the white-noise process W(t). From random process theory, it is 
recognized that the autocorrelation function and power spectral density of 
a random process form a Fourier transform pair. Since the white-noise 
process W(t) is assumed to have a constant power spectral density of 
N,/2, it follows that the autocorrelation function of such a process consists 
of a delta function weighted by No/2. Specifically, we may write 


N 
Rt; — h) = T O(t — t, + tp) (10.53) 
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Substituting Eq. 10.53 in 10.52, and using the property that the total area 
under the Dirac delta function ô(t — t, + t) is unity, we get 


2 


NoT,A? 
oh = = 


5 (10.54) 
The statistical characterization of the correlator output is completed by 
noting that it is Gaussian distributed, since the white noise at the correlator 
input is itself Gaussian (by assumption). In summary, we may state that 
under hypothesis H, the correlator output is a Gaussian random variable 
with zero mean and variance NT,A?/2, as shown by 


fo(y) = ve (10.55) 


1 
5 o 
VaNoT,A o( NoT,A? 


where the subscript in f(y) signifies the condition that symbol 0 was sent. 

Figure 10.13a shows the bell-shaped curve for the probability density 
function of the correlator output, given that symbol 0 was transmitted. The 
probability of the receiver deciding in favor of symbol 1 is given by the 
area shown shaded in Fig. 10.13a. The part of the y-axis covered by this 


fyi foly) 


(a) 
fy fi (y) 


Figure 10.13 > 
Conditional probability of error calculations. (a) Conditional probability of error, 
given that symbol was sent. (b) Conditional probability of error, given that symbol 1 
was sent. 
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area corresponds to the condition that the correlator output y is in excess 
of the threshold 4 defined by Eq. 10.47. Pet P. denote the first conditional 
probability of error, given that symbol 0 was sent. Hence, we may write 


Pa = | foly) ay 


jl o y ) 
= — exp| - ———— ] d 10.56) 
VaNoT,A hi o( NoT, A? 4 ( 
Define 
y 
ar (10.57) 
VNT, A 


We may then rewrite Eq. 10.56 in terms of the new variable z as 


PBa exp(-z?) dz (10.58) 


ee! l 
Va VA"T,/4No 


Equation 10.58 can only be solved using numerical methods. A similar 
integral has been tabulated and is known as the complementary error function® 


etfe(u) = = i ” exp(= 22) dz (10.59) 
N Ju 


Accordingly, we may redefine the conditional probability of error P. in 
terms of the complementary error function as 


S AT 
Pa == erte( ) (10.60) 


Consider next the second kind of error that occurs when symbol 1 is 
sent and the receiver chooses symbol 0. Under this condition, correspond- 


®The complementary error function is related to the error function as 
erfc(u) = 1 — erf(u) 
where erf(u) is the error function defined by (see Section 8.3) 


erf(u) = al exp(—z2) dz 


For large values of u, the error function approaches unity, in which case it is 
numerically more convenient to work with the complementary error function. A 
short table of values of the error function erf(u) for u in the range 0 to 3.3 is given 
in Table 6 of Appendix D. 
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ing to hypothesis H,, the correlator input consists of a rectangular pulse 
of amplitude A and duration T, plus the channel noise w(t). We may thus 
_ apply Eq. 10.48 to write 


Hy =A ie [A + wO] dt (10.61) 


The fixed quantity A in the integrand of Eq. 10.61 serves to shift the 
correlator output from a mean value of zero volt under hypothesis Ho to 
a mean value of A’7, under hypothesis H,. However, the conditional 
variance of the correlator output under hypothesis H, has the same value 
as that under hypothesis Hj. Moreover, the correlator output is Gaussian 
distributed as before. In summary, the correlator output under hypothesis 
H, is a Gaussian random variable with mean A*T7, and variance NjT;,7/2, . 
as depicted in Fig. 10.13b. Let Pa denote the second conditional probability 
of error, given that symbol 1 was sent. This probability equals the area 
shown shaded in Fig. 10.135, which corresponds to those values of the 
correlator output less than the threshold 4 set at A?7,/2. From the sym- 
metric nature of the Gaussian density function, it is clear that 


Pa = Po (10.62) 


Note that this statement is only true when the a priori probabilities p and 
q are equal; this assumption was made in calculating the threshold A. 


AVERAGE PROBABILITY OF ERROR 


To determine the average probability of error of the PCM receiver, we 
note that the two possible kinds of error just considered are mutually 
exclusive events. Thus, with the a priori probability of transmitting a 0 
equal to p, and the a priori probability of transmitting a 1 equal to q, we 
find that the average probability of error, P., is given by 


P, = pPao + GPa (10.63) 


Since Pa = Pao, and p + q = 1, Eq. 10.63 simplifies as 


P. TT P.o = Pa 
or 
1 1 A'T, 
Ee = 10.64 
B: 5 ere N, ) (10.64) 


The term A?T;, equals the signal energy when symbol 1 is sent. Let the 
dimensionless parameter y, denote the signal energy-to-noise power spectral 
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density ratio under this condition, as defined by 


_ AT, 


10.65 
a (10.65) 


mM 


We may interpret the parameter y, in another way. We observe that A’ 
denotes the peak signal power. The ratio No/T, denotes the average noise 
power measured in a bandwidth equal to the bit rate 1/T,. The parameter 
y is therefore the ratio of the peak signal power to the average noise power 
so defined. 

We may thus express the average probability of error of the optimum 
binary PCM system using on-off signaling in terms of 7, as 


erte Vi) (10.66) 


This formula shows that the average probability of error P, depends solely 
on the signal energy-to-noise power spectral density ratio 7,. Figure 10.14 
shows P, plotted versus 7; in decibels. We see that the average probability 
of error P, decreases very rapidly as the signal energy-to-noise power 
spectral density ratio y; is increased, so that eventually a very small increase 
in the signal energy will make the reception of binary data over a white 
Gaussian noise channel almost error free. Clearly, there is an error thresh- 


10? 


1078 


Probability of error, P, 


10-10 


Signal energy-to-noise power spectral density ratio 
ny, dB 


Figure 10.14 
Probability of error in a PCM receiver. 
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old (at about 17 dB) below which the receiver performance may involve 
significant numbers of errors and above which the effect of channel noise 
- is practically negligible. In other words, provided that the signal energy- 
to-noise power spectral density ratio 7, exceeds the error threshold, channel 
noise has virtually no effect on the receiver performance, which is precisely 
the goal of PCM. When, however, y, drops below the error threshold, 
there is a sharp increase in the rate at which errors occur in the receiver. 
Because decision errors result in the construction of incorrect code words, 
we find that when the errors are frequent, the reconstructed message at 
the receiver output bears little resemblance to the original message. In 
such a situation, we say the message has become mutilated by decoding 
noise. 


EXERCISE 7 Using a procedure similar to that described for deriving P.o, 
show that the conditional probability of error of the second kind, Pa, has 
the same value as that given by Eq. 10.60. 


EXERCISE 8 Consider the suboptimum binary PCM receiver shown in 
_ Fig. 10.15. It involves the use of an ideal low-pass filter, followed by a 
sampler. The output of the sampler is compared to a threshold, and then 
-a decision is made in favor of binary symbol 1 or 0. The transmitted PCM 
signal uses an on-off format with symbol 1 represented by A volts, and 
symbol 0 represented by zero volt. The symbols 1 and 0 occur with equal 
probability, thereby justifying the use of a threshold of A/2 volts. | 


(a) Show that the average probability of error of this receiver is given 


by | 
i : 
P, = = erfe| : 
2 2V20 
PCM 

"D. l Choose 1 if y, > 4 
Ideal a Se 
low-pass Oo ky| Decision a 


4 device 
filter Otherwise, choose 0 


at time 
t= te. “ 
White noise Threshold 
w(t) : A 


Figure 10.15 
Suboptimum receiver for binary-encoded PCM wave. 
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where o? = NoB, with B equal to the low-pass filter bandwidth and — 
No/2 equal to the power spectral density of the channel noise (assumed 
to be white and Gaussian with zero mean). — oe 
(b) Set the bandwidth B equal to the bit rate ite be By how. many 

decibels is the receiver of Fig. 10.15 inferior to the matched filter receiver 
of Fig. 10.2? ; 
(c) Repeat your safeulatich in part b for the bandwidth B set at the 
optimum value 0.685/T,, waese T, is the bit duration = Fig. 10.9). 


BOSCO 10.7 NOISE IN DIGITAL MODULATION SCHEMES. 


The binary hypothesis-testing procedure described by Eq. 10.44 may also 
be applied to evaluate the noise performance of the various digital mod- 
ulation schemes described in Section 7.15. In this context, we may identify 
the following detection scenarios in the presence of additive white Gaussian 
noise at the receiver input: 


1. Coherent detection of binary amplitude-shift keying (ASK), phase-shift 
keying (PSK), and frequency-shift keying (FSK) signals, assuming that 
the receiver has perfect knowledge of the phase of the received signal: 
In other words, there is phase synchronization between the receiver and 
transmitter. The phase may be estimated from the received signal. For 
example, in the case of binary PSK we may achieve phase synchroniz- 
ation by using a Costas loop (see Section 7.2). Alternatively, provision 
for phase synchronization may be made by sending a pilot carrier at the 
cost of some wastage in transmitted power. The coherent detection of 
binary ASK, PSK, and FSK signals is considered in Section 10.8. The 
treatment of binary ASK signals follows directly from Eq. 10.44. For 
the treatment of binary PSK and FSK signals, we consider them as 
special cases of a generalized binary hypothesis-testing procedure that 
involves a pair of arbitrary signals with equal energy, which represent 
binary symbols 1 and 0. 

2. Noncoherent detection of binary ASK and FSK signals, ignoring the 
phase information contained in the received signal: The motivation for 
doing this is to simplify the receiver design. However, the price paid 
for this simplification is an inferior noise performance, compared to a 
corresponding receiver that is coherent. A mathematical treatment of 
the noncoherent detection of binary ASK and FSK signals is complicated 
and beyond the scope of this introductory book. We therefore content 
ourselves by presenting highlights of the noncoherent detection of ASK 
and FSK signals in Section 10.9. 

3. Differential phase-shift keying (DPSK), which may be viewed as the 
noncoherent version of binary phase-shift keying (PSK). As remarked 
in Section 7.15, PSK signals cannot be detected noncoherently because 
they use a single carrier frequency and have a constant envelope. Thus, 


cocosecrveccsosccsce 
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DPSK may be used as an alternative to PSK. This form of digital mod- 
ulation is considered in Section 10.9. 


4. Coherent detection of quadriphase-shift keying (QPSK) and minimum 
shift keying (MSK) signals. This issue is considered in Section 10.10. 


In all these schemes, it is assumed that the receiver is properly bit-timed, 
so that the receiver may perform its decisions on received symbols in 
synchronism with the interbit transition points in the original binary data 
stream. Bit-timing information may be extracted from the received signal 
by the use of appropriate circuitry.’ 

The generation and coherent detection of M-ary ASK and M-ary PSK 
signals (for all M) involve only the use of linear operations. These digital 
modulation schemes are therefore said to be linear. Also, it is of interest 
to note that M-ary ASK and M-ary PSK signals are sometimes combined 
to produce hybrid amplitude-phase keying (APK); this is done in order to 
provide a more efficient use of channel bandwidth. A popular form of APK 
is M-ary quadrature-amplitude modulation (QAM), which consists of the 
quadrature multiplexing of two M-ary ASK signals. However, unlike M- 
ary PSK and M-ary FSK signals, we find that APK signals do not have a 
constant envelope and therefore require the use of a linear channel for 
their transmission.’° 


10.8 COHERENT DETECTION OF BINARY MODULATED WAVES 


Let so(t) and s,(t) denote the signals used to represent binary symbols 0 
and 1, respectively. We may then distinguish between binary ASK, binary 
FSK, and binary PSK signals, as follows: 


1. Binary ASK signals 


5,(t) = A, cos(2zf,t), symbol 1 (10.67) 
S(t) = 0, symbol 0 
2. Binary PSK signals 
= 1 
s\(t) = A, cos(2zf,t), symbol (10.68) 
So(t) = A, cos(2af,t + n) symbol 0 
3. Binary FSK signals 
s(t) = A, cos(27 f:t), symbol 1 (10.69) 
So(t) = A, cos(2zf,t), symbol 0 


°For a discussion of the synchronization problem in digital communications, see 
Lindsey and Simon (1973, Chapters 2 and 9). 

For a discussion of M-ary PSK and M-ary FSK, and M-ary QAM schemes, see 
Haykin (1988, pp. 313-38). 
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In both parts of Eqs. 10.67 through 10.69, we have 0 < t < T,, where T, 
is the bit duration. We usually find that in the case of FSK signals, the 
frequencies fı and f, are both large compared with the bit rate 1/T7,, 
whereas in the case of ASK and PSK signals, f. is large compared with 
1/T,. Moreover, in both PSK and FSK signals, the same signal energy per 
bit is transmitted, as shown by 


oe | OW | s3(t) dt 
0 0 


JAT, 
2 


(10.70) 


In ASK signals, on the other hand, the transmitted signal energy alternates 
between 0 (when symbol 0 is sent) and the value A? T,/2 (when symbol 1 
is sent). In this case, we define the average signal energy per bit as 


_ AiTs 


E 
av 4 


(10.71) 


Throughout the discussion, we assume that symbols 0 and 1 are sent with 
equal probability; that is, 


1 
P= q= 5 (10.72) 


COHERENT DETECTION OF BINARY ASK SIGNALS 


The receiver for coherent detection of binary ASK signals is shown in Fig. 
10.16, which follows directly from the single-path correlation receiver of 
Fig. 10.12. Assuming that symbols 1 and 0 are equally likely, the threshold 
A is calculated from Eq. 10.45 as 


Act, (10.73) 


where we have made use of Eq. 10.70. To calculate the average probability 
of error for the coherent binary ASK receiver of Fig. 10.16, we may follow 
a procedure similar to that used for the binary (unipolar) PCM receiver 
in Section 10.6. A more expedient approach, however, is to recognize that 
the operation of a matched filter (correlation) receiver in additive white 
Gaussian noise depends only on the ratio of signal energy-to-noise power 
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Choose symbol 1 if 
o threshold is exceeded. 
device 
Otherwise, choose symbol 0. 
s(t) Threshold 
A= Az T,,/4 


Figure 10.16 
Coherent receiver for the detection of binary ASK signals. 


spectral density and not on the signal waveform. (See Property 3 of matched 
filters in Section 10.3.) Accordingly, we may calculate the average prob- 
ability of error for coherent binary ASK by substituting A2T7,/2 (signal 
energy for symbol 1 in binary ASK) for A°T, (signal energy for symbol 1 
in binary PCM) in Eq. 10.64. We may thus express the average probability 
of error in coherent binary ASK as 


1 IAT, 
P, = 5 ete(5 ZN, ) (10.74) 


Using the definition of average signal energy per bit given in Eq. 10.71, 
we may rewrite the formula of Eq. 10.74 as 


1 JD 
P, = 5 ere Ea) (10.75) 


GENERALIZED COHERENT RECEIVER FOR BINARY DECISION-MAKING 


The optimum receiver for the coherent detection of binary FSK and PSK 
signals may be viewed as special cases of the two-path coherent correlation 
receiver shown in Fig. 10.17. This receiver represents a generalization of 
the single-path correlation receiver of Fig. 10.12. We assume that the 
receiver of Fig. 10.17 is synchronized to the transmitter, which is equivalent 
to saying that (1) the receiver is equipped with replicas of the transmitted 
signals s,(t) and s,(t), and (2) the timing of the decision-making process 
performed by the receiver is coincident with the bit timing of the trans- 
mitted signal. 
The receiver output / in Fig. 10.17 is given by 


fe | OEO — so(t)| dt (10.76) 
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Choose 1 
ifi>0 
(2) Decision 
x 
device Otherwise, 
choose 0 


S(t) 


Figure 10.17 
Generalized two-path correlation receiver. 


where x(t) is the noise-contaminated received signal. The output / is com- 
pared with a threshold of zero volt; this threshold is chosen assuming that 
symbols 1 and 0 occur with equal probability. If / is greater than zero, the 
receiver chooses symbol 1; otherwise, it chooses symbol 0. Since the chan- 
nel noise w(t) is Gaussian, it follows that the receiver output is likewise 
Gaussian distributed. The mean value of the receiver output is conditional 
on whether symbol 0 or 1 was actually sent. However, the variance of the 
correlator output is the same, regardless of whether symbol 0 or 1 was 
sent. 

Following a procedure similar to that described in Section 10.6, we may 
show that the conditional mean of the correlator output, given that symbol 
0 was sent, is defined by 


3 
| 


= [E OO = O] a 
EE <p) (10.77) 


where E, is the signal energy per bit. The parameter p is the correlation 
coefficient of the signals sọ(t) and s,(t), defined by 


Í wO dt 
0 
pee T. -Gi r. O A2 


[Poa] | ft a] 


= i O O (10.78) 


The correlation coefficient p has an absolute value less than or equal to 
unity. The conditional mean of the correlator output, given that symbol 1 
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was sent, is defined by 
We may also show that the conditional variance oj of the correlator 


output given that symbol 0 was sent, and its conditional variance a? given 
that symbol 1 was sent, have a common value defined by 


a aa 
=F [O - sor at 
= NoE,(1 — p) (10.80) 


An error of the first kind occurs when we send symbol 0, but the cor- 
relator output / is greater than zero volt, and the receiver therefore chooses 
symbol 1. An error of the second kind occurs when we send symbol 1, but 
the correlator output / is less than zero volt, and the receiver therefore 
chooses symbol 0. From the symmetry of the receiver of Fig. 10.17, it is 
apparent that the (conditional) probabilities of both kinds of error are 
equal. Thus, recognizing that the correlator output is Gaussian distributed 
with conditional means +F,(1 — p) and variance NjE,(1 — p), and as- 
suming that symbols 0 and 1 occur with equal probability (which justifies 
the use of a threshold equal to zero volt), we find that the average prob- 
ability of error in the receiver of Fig. 10.17 is given by 


l ote{ [Eo = 
P, = 5 erte( ZN, ) (10.81) 


We may now consider the following two special cases: 


1. Coherent detection of binary PSK signals. In the case of binary PSK 
signals, the coherent receiver reduces to a single path as in Fig. 10.18a. 
This follows from the fact that s(t) is the negative of s,(t). Moreover, 
the correlation coefficient p = —1. A pair of equienergy signals for 
which the correlation coefficient equals — 1 are called antipodal signals. 
Thus, putting p = —1 in Eq. 10.81 gives the average probability of 
symbol error in a coherent binary PSK receiver as 


1 [Ey 
= = 10.82 
P: 5 erte( En) (10.82) 


2. Coherent detection of binary FSK signals. The coherent receiver for 
binary FSK signals is shown in Fig. 10.18b. The frequencies f, and f, 
of the FSK signal are usually spaced far enough apart to justify treating 
the signals s)(t) and s,(t) as orthogonal with each other. This condition 
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Choose 1 
fl>0 
Otherwise, 
choose 0 


(a) 


Choose 1 
B iLO 
x(t) Decision 
device Otherwise, 
choose O 


A, cos(27f9t) 


(b) 
Figure 10.18 
(a) Coherent receiver for PSK signals. (b) Coherent receiver for FSK signals. 


corresponds to having the correlation parameter p = 0. Therefore, 
putting p = Oin Eq. 10.81, we find that the average probability of error 
in a coherent binary FSK receiver is given by 


=! orl |e 
P, = > erte( 2) (10.83) 


Comparing Eqs. 10.75 and 10.83, we see that the coherent receivers for 
binary ASK and binary FSK signals exhibit the same average probability 
of error when the average signal energy per bit, Ew, in binary ASK is the 
same as the signal energy per bit, E,, in binary FSK. 


EXERCISE 9 For the PET correlation binary receiver shown in 
Fig. 10. i, show that the conditional means m and m,, and the common 
value of the conditional variances a3 and g? are given by Egs. 10. he 10. 19; 
and 10.80, respectively. 


EXERCISE 10 Using the formula for the Gaussian probability density 
function, derive Eq. 10.81 for the eee cone a of) error in the gen- 
- eralized receiver of Fig. 10.17. 
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soa 10.9 NONCOHERENT DETECTION OF BINARY MODULATED WAVES 


Up to this point in our discussion, we have assumed that the information- 
bearing signal is completely known at the receiver. In practice, however, 
it is often found that in addition to the uncertainty due to the channel 
noise, there is an additional uncertainty due to the randomness of signal 
parameters. The usual cause of this uncertainty is distortion in the trans- 
mission medium. Perhaps the most common random signal parameter is 
the phase, which is especially true for narrow-band signals. For example, 
transmission over a multiplicity of paths of different and variable lengths, 
or rapidly varying delays in the propagating medium from transmitter 
to receiver, may cause the phase of the received signal to change in a 
way that the receiver cannot follow. Synchronization with the phase of 
the transmitted carrier may then be too costly, and the designer may 
simply choose to disregard the phase information in the received signal 
at the expense of some degradation in the noise performance of the 
system. 

In this section, we first consider the noncoherent detection of binary 
FSK signals and then address differential phase-shift keying (DPSK). 


NONCOHERENT DETECTION OF BINARY FSK SIGNALS 


In this case, the receiver is composed of a pair of matched filters followed 
by envelope detectors, as in Fig. 10.19. One of the two filters is matched 
to the signal s9(t) = A, cos(2zf,t) corresponding to the transmission of 
symbol 0, and the other filter is matched to the signal s,(t) = A, cos(27f;t) 
corresponding to the transmission of symbol 1. The envelope detectors 
serve the purpose of destroying the dependence of the matched filter 
outputs on the unknown phase of the received signal. The resulting en- 
velopes are sampled once every T, seconds. Let h and /, denote the en- 
velope samples of the lower and upper paths of the receiver, respectively. 
Then, if 4 > h, the receiver chooses symbol 1; otherwise, it chooses sym- 
bol 0. 

The receiver commits an error of the first kind when symbol 0 is trans- 
mitted but the presence of channel noise makes /, greater than h and the 
receiver therefore chooses symbol 1. It commits an error of the second 
kind when symbol 1 is transmitted but owing to channel noise l is greater 
than /, and the receiver therefore chooses symbol 0. The inclusion of 
envelope detectors in the receiver of Fig. 10.19 makes the evaluation of 
these two conditional probabilities of error rather complicated. The reason 
for the complication is that envelope detection is a nonlinear operation, 
with the result that the random variables obtained by sampling the envelope 
detector outputs are no longer Gaussian distributed. For the present dis- 
cussion, we simply state the formula for the average probability of error 
P, in the noncoherent FSK receiver of Fig. 10.19, assuming that symbols 
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Noncoherent receiver for the detection of FSK signals. 
1 and 0 occur with equal probability. The formula for P, is" 
1 E, 
P, = 5 EXP TJN, (10.84) 
0 


where E, is the transmitted FSK signal energy per bit and N,/2 is the power 
spectral density of the channel noise (assumed to be white and zero-mean 
Gaussian). 

We also note that when the signal-to-noise ratio is high, the average 
probability of error for the noncoherent detection of binary ASK signals 
is the same as that for the noncoherent detection of binary FSK signals, 
provided that the average signal energy per bit in binary ASK is the same 
as the signal energy per bit in binary FSK. 


DIFFERENTIAL PHASE-SHIFT KEYING 


The method of differential phase-shift keying (DPSK) may be viewed as 
the “noncoherent”’ version of phase-shift keying. It operates on the as- 
sumption that the unknown phase @ of the received signal remains essen- 
tially constant over two-bit intervals. In the context of noise performance, 
the major difference between a DPSK system and a coherent binary PSK 
system is not in the differential encoding, which can be used in any case, 
but rather it lies in the way in which the reference signal is derived for the 
phase detection of the received signal. Specifically, in a DPSK receiver the 


"For a derivation of Eq. 10.84, see Haykin (1988, pp. 300-307). 
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reference is contaminated by additive noise to the same extent as the 

information pulse; that is, they have the same signal-to-noise ratio. This 

_ makes the determination of the overall probability of error in DPSK re- 

= ceivers somewhat complicated. Therefore, it will not be given here. How- 
ever, the result is! 


1 
P = — 2a 7 
ea exp En) (10.85) 


It is of interest to note that, since in a DPSK receiver decisions are made 
on the basis of the signal received in two successive bit intervals, there is 
a tendency for bit errors to occur in pairs. 


Secsescsccecenccsee -10.10 COHERENT DETECTION OF QUATERNARY MODULATED WAVES 


A limitation of binary modulated waves is that they do not make the most 
efficient use of channel bandwidth, which represents a precious commun- 
ication resource. One way of improving bandwidth utilization is to use 
quadrature multiplexing. Two important examples of such an approach are 
quadriphase-shift keying (QPSK) and minimum shift keying, (MSK), which 
were considered in Section 7.15. In QPSK, a special form of phase modu- 
lation, the carrier assumes one of four equispaced phase shifts (e.g., 
+n/4, +3x/4) in response to one of the four possible (Gray encoded) 
dibits 00, 10, 11, and 01. In MSK, a special form of frequency modulation, 
phase continuity is maintained at the interbit transition points of the in- 
coming binary data stream, and the change in carrier frequency from sym- 
bol 1 to symbol 0 is chosen to be equal to one half the bit rate of the binary 
data. 

Although QPSK and MSK have different waveforms and employ dif- 
ferent methods for their generation and detection, they exhibit the same 
performance when they are coherently detected in the presence of additive 
white Gaussian noise at the receiver input. In the sequel, we present a 
derivation for the average probability of symbol error for QPSK, which 
represents an extension of the result obtained previously for the coherent 
detection of binary PSK signals. 

In Fig. 10.20 we show a coherent receiver for the detection of QPSK. 
We assume that the receiver (channel) noise is zero-mean white Gaussian 
with power spectral density N,/2. We also assume that all four Gray- 
encoded dibits 00, 10, 11, and 01 occur with equal probability. We note 
that this receiver may be viewed as a quadrature-multiplexed version of 
two coherent binary PSK receivers; one receiver operates with the carrier 
cos(2zf,t), and the other receiver operates with the carrier sin(27f,t). We 
may therefore equate the probability of error P, for the in-phase channel 


_12For a derivation of Eq. 10.85, see Haykin (1988), pp. 307-309. 
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Figure 10.20 
QPSK receiver. 


and the probability of error P, for the quadrature channel in Fig. 10.20 
to that for the coherent detection of binary PSK signals. In particular, we 


may write 
1 |E 
Pa = Po = | E) (10.86) 


where E is the transmitted signal energy per symbol. The probability that 
the QPSK receiver will correctly identify the transmitted data sequence is 
equal to the probabilities that both correlators in the in-phase and quad- 
rature paths of the receiver yield correct results. Let P, denote the average 
probability of correct reception. We may then write 


P= (=P) aes (10.87) 


We may simplify Eq. 10.87 by noting that P., = P.g and that they both 
usually have a small value compared to unity. Accordingly, we may ap- 
proximate Eq. 10.87 as 


P=1 oe (10.88) 
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The average probability of symbol error in the QPSK receiver of Fig. 10.20 
is therefore given by 


P,=1-P, 
a2 Py 


= ete E) (10.89) 


In a QPSK system, there are two bits per symbol, so that the signal 
energy per symbol is twice the signal energy per bit; that is, 


E = 2E, (10.90) 


Thus, expressing the average probability of symbol error in terms of the 


ratio E,/Nọ, we may write 
|E» 
P, = erf = 10.91 
e ~= er ( Es) (10.91) 


As mentioned previously, MSK has the same noise performance as 
QPSK when they are both detected coherently in the presence of additive 
white Gaussian noise. Accordingly, we may also use Eq. 10.91 to calculate 
the average probability of symbol error in a coherent MSK receiver. 


- EXERCISE 11 Explain the reason for the use of 2N (for the effect of — 
noise) in the formula for the average probability of error in the in-phase 
_ Or quadrature channel given in Eq. 10.86. at 


sooroo 10.11 DISCUSSION 


Throughout this chapter we have used the overall probability of committing 
a symbol error as the figure of merit for evaluating the noise performance 
of a digital communication system. It should be realized, however, that 
even if two systems yield the same symbol error probability, their per- 
formances, from the users’ viewpoint, may be quite different. In particular, 
the greater the number of bits per symbol, the more the bit errors will 
cluster together. For example, if the symbol error probability is 107°, the 
expected number of symbols occurring between any two erroneous symbols 
is 1000. If each symbol represents 1 bit of information (as in a binary PSK 
or binary FSK system), the expected number of bits separating two erro- 
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neous bits is 1000. If, on the other hand, there are 2 bits per symbol (as 
in a QPSK system), the expected separation is 2000 bits. Of course, a 
symbol error generally creates more bit errors in the second case, so that 
the percentage of bit errors tends to be the same. Nevertheless, this clus- 
tering effect may make one system more attractive than another, even at 
the same symbol error rate. In the final analysis, which system is preferable 
will depend on the particular situation. 

Two systems having an unequal number of symbols may be compared 
in a meaningful way only if they use the same amount of energy to transmit 
each bit of information. It is the total amount of energy needed to transmit 
the complete message that represents the cost of the transmission, not the 
amount of energy needed to transmit a particular symbol satisfactorily. 
Accordingly, in comparing the different data transmission systems consid- 
ered in this chapter, we will use, as the basis of our comparison, the 
probability of symbol error expressed as a function of the signal energy per 
bit-to-average noise power per unit bandwidth ratio; that is E,/ No. 

In Table 10.1, we have summarized the expressions for the symbol error 
probability P, for coherent binary PSK, coherent binary FSK, noncoherent 
binary FSK, DPSK, and coherent QPSK and MSK. In Fig. 10.21 we have 
used these expressions to plot P, as a function of E,/No. In practice, we 
generally design a digital communication system for an average probability 
of symbol error P, equal to 10~‘ or less. On the basis of the curves in Fig. 
10.21, we may state the following: 


1. The error rates for all the systems decrease monotonically with increas- 
ing values of E,/No. 


TABLE 10.1 Summary of Formulas for the Symbol Error Probability P, for 
Different Digital Modulation Techniques 


. 1 IE 

Coherent binary PSK = =) 
y 7 erte( E) 
Coherent binary FSK 1 erfcl 4 | Es 
2 2N, 


Coherent QPSK E, 
Coherent MSK erfc N. 
0 
Noncoherent binary FSK 2 exp| — 2 
2 2No 


1 E 
DPSK = Pg 
7 exn( =) 


DISCUSSION 587 


107? 
Coherent QPSK 
af Coherent MSK 
S 
& 107? 
© 
2 
a 
[e] 
a2 
fo} 
a 
HAN 
10-4 \ 
= =25 0 2.5 5.0 Use 10 W225 
Ep 
No! dB 
Figure 10.21 


Comparison of the noise performances of different PSK and FSK systems. 


Zz 


For any value of E,/No, coherent PSK produces a smaller error rate 
than any of the other systems. 


. The phase modulation systems, coherent binary PSK and DPSK, require 


an E/N, that is 3 dB less than their frequency modulation system 
counterparts—coherent binary FSK and noncoherent binary FSK, re- 
spectively—to realize the same error rate. 


. At high values of E,/N,, the noncoherent receivers, DPSK and non- 


coherent binary FSK, perform almost as well (to within about 1 dB) as 
their coherent counterparts, PSK and coherent binary FSK, respec- 
tively, for the same bit rate and signal energy per bit. 
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5. The QPSK system transmits, in a given bandwidth, twice as many bits 
of information as a coherent binary PSK system. Also, for high values 
of E,/No, the error rates of both systems are approximately the same. 
The improvement in capacity resulting from the use of QPSK, however, 
is attained at the cost of increased complexity. 


From Fig. 10.21, we also see that at high values of E,/No we have 
approximately a 4-dB difference between the best signaling method (co- 
herent binary PSK) and the worst signaling method (noncoherent binary 
FSK). It may appear that this represents a small improvement in signal- 
to-noise ratio in return for the increased receiver complexity. However, 
in some applications where power is at a premium (e.g., as in digital satellite 
communications) even a 1-dB saving in signal-to-noise ratio is well worth 
the effort. 


EErEE Ee esena 10.12 TRADEOFFS IN M-ARY DATA TRANSMISSION 


We complete our discussion of noise in digital modulation schemes by 
looking at the tradeoffs involved in M-ary PSK and M-ary FSK in the light 
of Shannon’s channel capacity theorem. As mentioned in Chapter 1, Shan- 
non’s channel capacity theorem states that in a band-limited communication 
channel that is perturbed by additive white Gaussian noise and that is 
subject to a power constraint, the channel capacity C (in bits per second) 
is defined by 


C = B log,(1 + SNR) (10.92) 


where B is the channel bandwidth (in hertz), and SNR denotes the received 
signal-to-noise ratio. The channel capacity C sets an upper limit on the rate 
at which information may be transmitted through the channel without 
error. 

Let P denote the average power of the received signal, and No/2 denote 
the power spectral density of the channel noise. We may express the average 
signal power P in terms of the signal energy per bit as follows 


P = 2 


i 
D 
D 


(10.93) 
where T, is the bit duration in seconds and R, (defined as 1/T,) is the bit 


rate in bits per second. In a bandwidth B, the average noise power (mea- 
sured over both negative and positive frequencies) equals No B. Hence, we 


The discussion presented herein is summarized from Haykin (1988), pp. 334-336. 
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may express the received signal-to-noise ratio as 


E, R, 
NB 
E/N; 


i (10.94) 


SNR = 


The ratio E,/No is the signal energy per bit-to-average noise power per unit 
bandwidth ratio, and R,/B is the bandwidth efficiency. The bandwidth 
efficiency, in units of bits per second per hertz, provides a measure of the 
extent to which channel bandwidth is being used. 

Since the channel capacity C sets an upper limit on the bit rate R,, we 
have 


RC (10.95) 


Thus, we may combine Eqs. 10.92, 10.94, and 10.95 to recast Shannon’s 
channel capacity theorem in the form: 


Ry _ E,/No 
Equivalently, we may write 
Epo ee 
n < R,/B (10.97) 


This relation states that for a specified bandwidth efficiency R;/B, the 
received signal energy per bit-to-noise power spectral density ratio E,/ No 
must satisfy Eq. 10.97 if transmission over the channel is to be error-free. 

In the limiting case when the channel bandwidth B is infinitely large 
(i.e., R,/B approaches zero), we find from Eq. 10.97 that the corresponding 
limit on E;/No is log.2 = 0.693 (i.e., —1.6 dB). This special value is 
referred to as the Shannon limit. 

In Fig. 10.22a, we show a plot of the bandwidth efficiency R,/B versus 
the signal energy per bit-to-average noise power per unit bandwidth ratio 
E,,/No for coherent M-ary PSK signaling for different numbers of phase 
levels defined by M = 2*, where K = 1, 2, 3, 4, 5, 6. Each point corre- 
sponds to an average probability of symbol error P, = 10~°. 

In Fig. 10.226 we show a plot of R,/B versus E,/N, for coherent M- 
ary FSK signaling for different numbers of frequency levels M = 2*, where 
K = 1, 2, 3, 4, 5, 6. Each point corresponds to an average probability of 
symbol error P, = 107°. It is assumed that the frequency separation of the 
M transmitted sinusoids is the minimum so that they are orthogonal. to 
each other over a signaling interval. 
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(a) Comparison of M-ary PSK with the ideal system. (b) Comparison of M-ary FSK 
with the ideal system. 
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In both parts of Fig. 10.22, we also show the capacity curve obtained 
by plotting Eq. 10.97 when it is satisfied with equality. 

Figure 10.22 clearly depicts the tradeoffs involved in the use of M-ary 
signaling. In particular, we may make the following observations: 


1. In the case of M-ary PSK, as the number of phase levels M is increased, 
the bandwidth efficiency is improved but at the expense of an increase 
in the required signal energy per bit (for M > 4). 

2. In the case of M-ary FSK, as the number of frequency levels M is 
increased, the required signal energy per bit is decreased but at the 
expense of reduced bandwidth efficiency (for M > 4). 


OO OOOO OOS O EOS AO SOOO EO EOE OOOO SOSOOLOOSESOOOE ESOT ES OOOO OSES OSOOSOOOOSOSETES OOOO OO SEH O OOO OOFESTESSOSSSOOOOSESE OOOH SEOSEOOSOEOSSOCOODOSOOEHOOOSOOOSOS DOSE HED: 


PROBLEMS 
P10.2 Maximization of Output Signal-to-Noise Ratio 
Problem 1 Consider the signal s(t) shown in Fig. P10.1. 


(a) Determine the impulse response of a filter matched to this signal 
and sketch it as a function of time. 

(b) Plot the matched filter output as a function of time. 

(c) What is the peak value of the output? 


Problem 2 The amplitude of the pulse in Fig. P10.1 is doubled. What is 
the factor by which the pulse duration has to be reduced, so that a filter 
matched to this new pulse has the same performance as the matched filter 
in Problem 1, when both filters operate in the same additive white Gaussian 
noise? 


P10.3 Properties of Matched Filters 


Problem 3 Consider a filter that is matched to an energy signal s,(t) of 
duration T seconds. The filter is excited by another energy signal s,(t), 


s(t) 


Figure P10.1 
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also of duration T seconds. Both signals are of equal energy E. Find the 
filter output sampled at time t = T, given the following alternatives: 


(a) The signals s,(t) and s,(t) are orthogonal to each other over the 
interval 0 <¢t < T. 

(b) The two signals are correlated with each other, and their correlation 
coefficient is equal to 0.5. (For the definition of correlation coefficient, 
use may be made of the formula given by the first line of Eq. 10.78). 


Problem 4 


(a) Let the signal s,(t) have the waveform shown in Fig. P10.2a. Plot 
the following waveforms: È 


(i) The impulse response of the corresponding matched filter. 
(ii) The filter ouput in response to s,(¢) as input. 


(b) Plot the waveform of the output of a filter matched to s,(t) but 
excited with an input having the waveform of s,(t) shown in Fig. P10.25. 
What is the value of the output at time t£ = 2? 


s1 (t) 
2 


Figure P10.2 


PROBLEMS 593 


|H(f)| 


Figure P10.3 


P10.4 Approximations in Matched Filter Design 
Problem 5 Consider a matched filter for the RF pulse: 


se A cos(2zf,t), 0<t<T 
~ 10, otherwise 


where A is the amplitude, T is the duration, and f, is the frequency. The 
frequency f. > 1/T, so that the pulse s(t) may be regarded as a narrow- 
band signal. The requirement is to approximate the matched filter with an 
ideal band-pass filter of bandwidth B; the amplitude response of the filter 
is shown in Fig. P10.3. The bandwidth B is chosen to maximize the output 
signal-to-noise ratio of the filter. 


(a) Find the bandwidth B of the filter. 
(b) By how many decibels is the maximum output signal-to-noise ratio 
of the approximating band-pass filter less than that of the matched filter? 


Problem 6 Repeat Problem 5 using the LCR filter shown in Fig. P10.4, 
which is tuned to the frequency f. of the RF pulse s(t). The requirement 
is to choose the 3-dB bandwidth of the filter so as to maximize the output 
signal-to-noise ratio of the filter. 


(a) Find the 3-dB bandwidth of the filter. What is the Q-factor of the 
filter? 


Figure P10.4 
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(b) By how many decibels is the maximum output signal-to-noise ratio 
of the LCR filter of Fig. P10.4 less than that of the matched filter? 


P10.6 Probability of Error for Binary PCM 


Problem 7 A binary PCM system is calculated to have an average prob- 
ability of error equal to 10-5. The system is used to transmit binary data 
at the rate of 5 megabits per second. 


(a) How many bits, on the average, are likely to be in error during a 
transmission period that lasts 2 sec? 
(b) Repeat the calculation for a transmission period of 1 min. 


Problem 8 A binary PCM wave uses the Manchester code to describe 
symbols 1 and 0, as illustrated in Fig. P10.5. The additive noise at the 
receiver input is white and Gaussian with zero mean and power spectral 
density N)/2. Assuming that symbols 1 and 0 occur with equal probability, 
find an expression for the average probability of error at the receiver 
output, using matched filters. 


P10.8 Coherent Detection of Binary Modulated Waves 


Problem 9 Consider a phase-locked loop consisting of a multiplier, loop 
filter, and voltage-controlled oscillator (VCO), as in Fig. P10.6. Let the 
signal applied to the multiplier input be a binary PSK signal defined by 


s(t) = A, cos[2af,t + k,m(t)] 


Symbol 1 Symbol 0 
Figure P10.5 
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Loop 
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r(t) 


Figure P10.6 


where k, is the phase sensitivity, and the data signal m(t) takes on the 
value +1 V for binary symbol 1 and —1 V for binary symbol 0. The VCO 
output is 


r(t) = A, sin[2zf,t + O(t)] 


(a) Evaluate the loop filter output, assuming that this filter removes the 
modulated components with carrier frequency 2f,. 

(b) Show that this output is proportional to the data signal m(t) when 
the loop is phase-locked, that is, 0(t) = 0. 


Problem 10 A binary PSK signal is applied to a correlation receiver that 
lacks perfect phase synchronization with the transmitter. Specifically, it is 
supplied with a local carrier whose phase differs from that of the carrier 
used in the transmitter by @ radians. 


(a) Determine the effect of the phase error ¢ on the average probability 
of error of this receiver. 

(b) As a check on the formula derived in part (a), show that when the 
phase error is zero the formula reduces to the same form as in Eq. 10.82. 


Problem 11 A binary FSK system transmits binary data at the rate of 
2.5 x 10° bits per second. During the course of transmission, white Gaus- 
sian noise of zero mean and power spectral density 107% watts per hertz 
is added to the signal. In the absence of noise, the amplitude of the received 
signal is 1 uV. Determine the average probability of error assuming co- 
herent detection of the binary FSK signal. For this calculation, you may 
use Table 6 of Appendix D for the error function. 


P10.9 Noncoherent Detection of Binary Modulated Waves 


Problem 12 An MSK signal is applied to a noncoherent FSK receiver. 
What is the average probability of error for this system? 
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Problem 13 Rank DPSK with the coherent versions of binary PSK and 
binary FSK and noncoherent binary FSK, assuming that the issue of interest 
is the following: 


(a) Simplicity of receiver implementation. 
(b) Minimum transmitted power for an average probability of error 
equal to 1074. 


Problem 14 Using the approximation 


exp(— x’) 
Vax ` 


calculate the ratio (P.)psx/(P.)ppsx, Where (P.)psx and (P.)ppsx refer to the 
average probability of error for PSK and DPSK, respectively. What is the 
value of this ratio for a signal energy per bit-to-average noise power per 
unit bandwidth ratio E,/N) = 10 dB? 


erfc(x) = 


Problem 15 The binary sequence 101011000 is transmitted over a noisy 
channel using DPSK, assuming an initial bit of 1. Owing to noise in the 
channel, an error is made in the fourth bit of the reconstructed binary 
sequence at the receiver output. Show that the next bit of this sequence 
will also be in error; that is, errors in a DPSK receiver tend to occur in 
pairs. 


P10.10 Coherent Detection of Quaternary Modulated Waves 


Problem 16 A QPSK signal is applied to a receiver that is improperly 
phase-synchronized with respect to the receiver. In particular, the local 
carrier applied to the correlator in the upper path of the receiver in Fig. 
10.20 is cos(2zf,t + ¢) and that applied to the correlator in the lower 
path is sin(2zf,t + ġ), where ¢ is the phase error. 
(a) Calculate the average probability of symbol error for this receiver. 
(b) As a check on the formula derived in part (a), show that when @ 
is zero it reduces to the same form as in Eq. 10.89. 


ene APPENDIX A 


I. system calculations and measurements involving the use of power ratios, 
it is customary practice to use a unit called the decibel. The decibel, com- 
monly abbreviated as dB, is one tenth of a larger unit, the bel.' In practice, 
however we find that for most applications the bel is too large a unit; hence, 
the wide use of dB as the unit for expressing power ratios. The dB is 
particularly appropriate for sound measurements because the ear responds 
to sound in an approximately logarithmic fashion. Thus, equal dB incre- 
ments are perceived by the ear as equal increments in sound. 

Let P denote the power at some point of interest in a system. Let Po 
denote the reference power level with which the power P is to be com- 
pared. The number of decibels in the power ratio P/P is defined as 
10 logio( P/P). For example, a power ratio of 2 corresponds to 3 dB, and 
a power ratio of 10 corresponds to 10 dB. 

We may also express the signal power P itself in dB if we divide P by 
one watt or one milliwatt. In the first case, we express the signal power P 
in dBW as 10 logi(P/1W), where W is the abbreviation for watt. In the 
second case, we express the signal power P in dBm as 10 log,( P/1mW), 
where mW is the abbreviation for milliwatt. 


‘The unit, bel, is named in honor of Alexander Graham Bell. In addition to inventing 
the telephone, Bell was the first to use logarithmic power measurements in sound 
and hearing research. 
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APPENDIX B 


coosceneeseeseoores 


A Bessel function of the first kind of order n and argument x, commonly 
denoted by J,(x), is defined by 


Roe = [ * exp(jx sind — jn6) dé (B.1) 
or, equivalently, 
1 fz : 
J,(x) = =| cos(x sind — n0) d0 (B.2) 
0 


Just as the trigonometric functions can be expanded in power series, so 
can the Bessel function J,(x) be expanded in a power series: 


£ (-1)”(ix) t?” 
Jy = ae : 
© 2 m!(n + m)! ED 
Evaluating Eq. B.3 for n = 0, 1, 2, for example, we thus have 
x ae x 
IW(xJ=l-Zte pe -Rae et’ (B.4) 


B.1 PROPERTIES OF BESSEL FUNCTION 


The Bessel function J,(x) has the following properties’: 


1. DO = CDI) (B.7) 


1For a mathematical treatment of Bessel functions, see Whittaker and Watson 
(1927), pp. 355-385. 
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To prove this relation, we replace 0 by (x — 0) in Eq. B.2. Then, noting 
that sin(z — 6) = sinf, we get 


1 fx 
J,(x) = = cos(x sinf + n@ — nz) d0 


1 fz 
= =I [cos(nz) cos(x sinf + n8) 
0 


+ sin(nz) sin(x sinf + n@)] dé 
For integer values of n, we have ae 

cos(nz) = (—1)” 

sin(nz) = 0 
. Therefore, 


J) = a [ cos(x sind + n0) d0 (B.8) 
From Eq. B.2 we also find that ne replacing n with —n: 
J_,(x) = aK cos(x sinf — n0) d0 (B.9) 
The desired result follows immediately from Eqs. B.8 and B.9. 


2. Jax) = (-1)4,(-x) (B.10) 
This relation is obtained by replacing x with — x in Eq. B.2, and then using 
Eq. B.8. 


3. Ja-1(x) + Inai(X) = Z ha) (B.11) 


This recurrence formula is useful in constructing tables of Bessel co- 
efficients. For example, the use of Eq. B.11 for n = 1 yields a value for 
J,(x) that is in exact agreement with that of Eq. B.5. 


4. For small values of x, we have 

x” 
2"n! 
This relation is obtained simply by retaining the first term in the power 


series of Eq. B.3 and ignoring the higher-order terms. Thus, when x is 
small, we have 


Iy(x) = (B.12) 


Jo(x) = 1 
I(x) => (B.13) 


5. For large values of x, we have 


Ja (x) = 2 cos( — i — zz) (B.14) 


This shows that for large values of x, the Bessel function J,(x) behaves 
like a sine wave with progressively decreasing amplitude. 
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6. With x real and fixed, J,(x) approaches zero as the order n goes to 
infinity. 


7. 5 J,(x) exp(jnd) = exp(jx sind) (B.15) 


n=% 


To prove this property, consider the sum 2,--. J,(x) exp(jng) and use 
the formula of Eq. B.1 for J,(x) to obtain 


S Ju(x) exp(ing) = = D expCind) |” expljx sind — jnd) a 


n=% 


Interchanging the order of integration and summation: 


E J.) expljng) 
1 


ar [ dé exp(jx sin) 5 exp[jn(@ — 0)] (B.16) 


From Example 14 of Chapter 2, we deduce that 
ig — 0) = + 5, expljn(ġ - 4], -n<sġ-0s<n (B.17) 


Therefore, substituting Eq. B.17 in B.16, and using the sifting property of 
a delta function, we get 


3 J,(x) exp(jnġ) 


n=—% 


| * exp(jx sin0)d(¢ — 0) dð 
= exp(jx sing) 


which is the desired result. 


8. > (x) = 1,  forallx (B.18) 


n=—-@ 


To prove this property, we may proceed as follows. We observe that J,(x) 
is real. Hence, multiplying Eq. B.1 by its complex conjugate, and summing 
over all possible values of n, we get 


œ 1 œ m 5 
r e ERT 
oe 2) Ory 2 ie R exp(jx sind 
— jn — jx sind + jno) d0 do 
Interchanging the order of double integration and summation: 


Dax) = = a ie dO dọ exp[jx(sind — sing)] 


x È exp[jn(@ — 0)]) (B.19) 


Substituting Eq. B.17 in B.19, and using the sifting property of a delta 
function, we finally get 
w 1 z 
J2 = = = 
> AG) = 5 F do =1 


n=% 


which is the desired result. 
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B.2 TABLE OF VALUES 


Table B.1 gives values of the Bessel function J,,(x) for values of the order 
n from 0 up to 14, and for values of the argument x in the interval (0.5, 
12): 

This table may be used to illustrate properties 3 through 8 listed in 
Section B.1. The reader is invited to do this as an exercise. 
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APPENDIX C 


aemm D XSTEM NOISE AND -CALCULATIONS 


LLITELIEEETIS ecccerecce 


The inevitable presence of noise in a communication system causes the 
reliable transmission of electrical signals through the system to be under- 
mined. It is therefore important to know how noise arises in the system. 
There are many potential sources of noise. The sources of noise may be 
external to the system (e.g., atmospheric noise, galactic noise, man-made 
noise) or internal to the system. The second category includes an important 
type of noise that arises owing to spontaneous fluctuations of current or 
voltage in electrical circuits. This type of noise, in one way or another, is 
present in every communication system and represents a fundamental lim- 
itation on the transmission or detection of signals. 

In this appendix we briefly discuss the physical sources of noise in elec- 
trical circuits and develop quantitative measures for assessing the presence 
of noise in a system. We finish the discussion by presenting link calculations 
for line-of-sight propagation through free space. 


C.1 ELECTRICAL NOISE 


In an electrical circuit, noise is generated owing to various physical phe- 
nomena.! We have thermal noise produced by the random motion of elec- 
trons in conducting media, and shot noise produced by random fluctuations 
of current flow in electronic devices. These two are the most common 
examples of spontaneous fluctuation noise encountered in electrical cir- 
cuits. 

Besides thermal noise and shot noise, transistors exhibit a low-frequency 
noise phenomenon known as flicker noise. The mean-square value of flicker 
noise is inversely proportional to frequency; hence, it is also referred to 
as “‘one-over-f’’ noise. Yet another type of noise encountered in semicon- 
ductor devices is burst noise, whose mean-square value falls off as 1/f?. 

Flicker noise and burst noise are both nonwhite, with their degrading 
effects being observed at low frequencies. Ordinarily, they can be ignored 
above a few kilohertz. On the other hand, thermal noise and shot noise 
are both white for all practical purposes; hence, their degrading influence 
on the operation of a communication system extends right across the com- 


‘For a detailed treatment of electrical noise, see Bell (1985), Van Der Ziel (1970) and 
Robinson (1974). 
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plete frequency band of interest. A brief discussion of thermal noise and 
shot noise is therefore in order. 


THERMAL NOISE 


Thermal noise? is an ubiquitous source of noise that arises from thermally 
induced motion of electrons in conducting media. In a conductor there is 
a large number of “free” electrons and an equally large number of ions 
bound by strong molecular forces. The ions vibrate randomly about their 
normal positions. The free electrons move along randomly oriented paths, 
owing to continuous collisions with the vibrating ions. The net effect of 
this random motion is an electric current that is likewise random. However, 
the mean value of the current is zero since, on the average, there are as 
many electrons moving in one direction as there are in another. 

A thorough analysis of thermal noise requires the use of thermodynamic 
and quantum mechanical considerations that are beyond the scope of this 
book. For the purpose of the discussion presented here, it suffices to say 
that the power spectral density of thermal noise produced by a resistor is 
given by? 


a 2h| f| 
where T is the absolute temperature in degrees Kelvin, k is Boltzmann’s 
constant, and h is Planck’s constant. Note that the power spectral density 
Sry(f) is measured in watts per hertz. For “low” frequencies defined by 


kT 
<2 
f h 


we may use the approximation 


h 
exp( 481) =1+ ms 


Correspondingly, we may approximate the formula of Eq. C.1 as follows 


Stw(f) = 2kT (C.2) 


2Thermal noise was first studied experimentally by Johnson in 1928, and for this 
reason it is sometimes referred to as “Johnson noise”; see Johnson (1928). 
Johnson’s experiments were confirmed theoretically by Nyquist; see Nyquist (1928). 
3For a discussion of the physical issues involved in the formulation of Eq. C.1, and 
for a historical account of the pertinent literature, see Bell (1985). 
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To develop a feeling for the frequencies for which the use of this approx- 
imate formula is justified, we assume operation at a room temperature of 
17°C, for which we have T = 290°K. Then, using the values of Boltzmann’s 
constant and Planck’s constant: 


k = 1.38 x 10-% joules/°K 
and 
h = 6.63 x 10-* joule - second 


we find that 
= = 6 X 10” Hz 


This upper frequency limit lies in the infrared region that is well above the 
spectrum of frequencies encountered in conventional electrical commun- 
ication systems. Therefore, for all practical purposes the use of the ap- 
proximate formula of Eq. C.2 is perfectly justified. 

Thus, given a resistor of R ohms, we find from Eq. C.2 that the mean- 
square value of the thermal noise voltage measured across the terminals of 
the resistor equals 


E[Viv] = 2RBySrw(f) 
= 4kTRBy volts? (C.3) 


where By, is the bandwidth (in hertz) over which the noise voltage is mea- 
sured. We may thus model a noisy resistor by the Thévenin equivalent 
circuit consisting of a noise voltage generator with a mean-square value of 
E[V%] in series with a noiseless resistor, as in Fig. C.1a. Alternatively, 


(a) (b) 


Figure C.1 
Models of a noisy resistor. (a) Thévenin equivalent circuit. (b) Norton equivalent 
circuit. 
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we may use the Norton equivalent circuit consisting of a noise current 
generator in parallel with a noiseless conductance, as in Fig. C.1b. The 
mean-square value of the noise current generator is 


il 
E[n] = R? El Vin] 
= 4kTGBy amps? (C.4) 


where G = 1/R is the conductance. 

It is also of interest to note that because the number of electrons in a 
resistor is very large and their random motions inside the resistor are 
statistically independent of each other, the central limit theorem indicates 
that thermal noise is Gaussian-distributed with zero mean. Accordingly, 
for the band of frequencies encountered in electrical communication sys- 
tems, we may model thermal noise as white Gaussian noise of zero mean. 


EXAMPLE 1 


eccccessscnce 


Consider a system for which the noise bandwidth By = 10 kHz, the absolute 
temperature T = 290°K (i.e., room temperature), and the resistance R = 
5 KQ. Then, the use of Eq. C.3 yields the mean-square value of the thermal 
noise voltage to be 0.8 x 10-7? volts squared. That is, the thermal noise 
voltage produced by the resistor has a root mean-square (rms) value equal 
; to 0.89 uV. 


e 
. 
Coooeesesoonaeaeseoossscoonooree® eeeeeesoocsce SOCOOOEEOOOOOSHOSOSOTSOOSSSSSSHOOOESSSOOOOS SOHO HOHOOOOSSHOSOOSLOSOOUSSSSOOOSEOS 


AVAILABLE NOISE POWER 


Coceovesesescesecsasees 


Noise calculations involve the transfer of power, so we find that the use 
of the maximum-power transfer theorem is applicable. This theorem states 
that the maximum possible power is transferred from a source of internal 
resistance R to a load of resistance R; when R; = R. Under this matched 
condition, the power produced by the source is divided equally between 
the internal resistance of the source and the load resistance, and the power 
delivered to the load is referred to as the available power. Applying the 
maximum-power transfer theorem to the Thévenin equivalent circuit of 
Fig. C.1a or the Norton equivalent circuit of Fig. C.1b, we find that a noisy 
resistor produces an available noise power equal to KTBy watts. 


SHOT NOISE 


Shot noise arises in electronic devices because of the discrete nature of 
current flow in the device. The process assumes the existance of an average 
current flow that manifests itself in the form of electrons flowing from the 
cathode to the plate in vacuum tubes, holes and electrons flowing in semi- 
conductor devices, and photons emitted in photodiodes. Although the av- 
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erage number of particles moving across the device per unit time is assumed 
to be constant, the process of current flow through the device exhibits 
fluctuations about the average value. The manner in which these fluctua- 
tions arise varies from one device to another. In a vacuum-tube device, 
the fluctuations are produced by the random emission of electrons from 
the cathode. In a semiconductor device, the cause is the random diffusion 
of electrons or the random recombination of electrons with holes. In a 
photodiode, it is the random emission of photons. In all these devices, the 
physical mechanism that controls current flow through the device has built- 
in statistical fluctuations about some average value. The shot noise pro- 
duced by these fluctuations is thus dependent on the average value of the 
current. 

Consider for example, a temperature-limited vacuum diode, shown in 
Fig. C.2. It consists of two electrodes enclosed in a vacuum: a cathode, 
which is heated so that it emits electrons; and an anode or plate, which is 
maintained at a positive potential with respect to the cathode so that it 
gathers the electrons. We assume that the cathode-plate potential differ- 
ence is large enough to cause the electrons emitted thermionically by the 
heated cathode to be pulled to the plate with such high velocities that 
space-charge effects are negligible. The plate current is then determined 
effectively by the rate at which electrons are emitted from the cathode. 
By considering the plate current as the sum of a succession of current 
pulses, with each pulse caused by the transit of one electron through the 
cathode-plate space, we find that the mean-square value of the randomly 
fluctuating component of the current is given by 


E[n] = 2qIBy amps? (C.5) 


where q is the electron charge equal to 1.60 x 107”? coulombs, J is the 
mean value of the current in amperes, and By is the bandwidth of the 
measuring instrument in hertz. Equation C.5 is called the Schottky formula. 
The typical transit time of an electron from cathode to plate is on the order 
of 10-° sec. The Schottky formula holds provided that the operating fre- 
quency is small compared with the reciprocal of the transit time, so that 
we may neglect transit time effects. 


Plate 
- Vacuum 


Cathode 


Figure C.2 
Temperature-limited vacuum diode. 
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Another important characteristic of shot noise is that it is Gaussian- 
distributed with zero mean. This follows from the fact that the number of 
electrons contributing to the shot noise current is very large, and their 
random emissions from the cathode are, for practical purposes, statistically 
independent of each other. Hence, the central limit theorem predicts a 
Gaussian distribution for shot noise. 

The Schottky formula (C.5) also holds for a semiconductor junction 
diode. In this case the mean value J of the current is given by the diode 
equation: 


I= nexp( 2) -I . (C.6) 


where V is the voltage applied across the diode and J, is the saturation 
current; the other constants are as defined previously. Thus, the current 7 
consists of two components that produce statistically independent shot- 
noise contributions of their own, as shown by 


Elh] = 2alvexo( 2) By + 2qI1,By 


= 2q(I + 21) By (C.7) 


Figure C.3 shows the noise model of a junction diode.* The model includes 
the dynamic resistance of the diode, defined by 


_ wv 
ôl 
TOL 
aUl EL) (C.8) 


r 


(a) (b) 


Figure C.3 
(a) Junction diode. (b) Shot-noise model. 


4For details of noise models for semiconductor diodes and transistors, see Robinson 
(1974), pp. 93-116. 
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Note, however, that the dynamic resistance r is noiseless since it does not 
involve power dissipation. 

In a bipolar junction transistor, shot noise is generated at both the emitter 
and collector junctions. On the other hand, in a junction field-effect tran- 
sistor the use of an insulated gate structure avoids junction shot noise; 
nevertheless, shot noise is produced by the flow of gate current. Of course, 
in both devices thermal noise arises from internal ohmic resistance: base 
resistance in a bipolar transistor and channel resistance in a field effect 
transistor. 


C.2 NOISE FIGURE 


A convenient measure of the noise performance of a linear two-port device 
is furnished by the noise figure,* which lends itself to both circuit analysis 
and measurement. Consider a linear two-port device connected to a signal 
source of internal impedance Z(f) = R(f) + jX(f) at the input, as in 
Fig. C.4. The noise voltage u(t) represents the thermal noise associated 
with the internal resistance R(f) of the source. The output noise of the 
device is made up of two contributions, one due to the source and the 
other due to the device itself. We define the available output noise power 
in a band of width By centered at frequency f as the maximum average noise 
power in this band obtainable at the output of the device. The maximum 
noise power that the two-port device can deliver to an external load is 
obtained when the load impedance is the complex conjugate of the output 
impedance of the device, that is, when the resistance is matched and the 
reactance is tuned out. We define the noise figure of the two-port device as 
the ratio of the total available output noise power (due to the device and the 
source) per unit bandwidth to the portion thereof due solely to the source. 


Figure C.4 
Linear two-port device. 


5For a classic paper on noise figure, see Friis (1944). 
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Let the spectral density of the total available noise power at the device 
output be Syo(f), and the spectral density of the available noise power 
due to the source at the device input be Sys(f). Also let G(f) denote the 
availabe power gain of the two-port device, defined as the ratio of the avail- 
able signal power at the output of the device to the available signal power 
of the source when the signal is a sinusoidal wave of frequency f. Then we 
may express the noise figure F(f) of the device as 


SMe 
FS) = Go) Sws(f) oe 


If the device were noise free, Syo(f) = G(f)Sns(f), and the noise figure 
would then be unity. In a physical device, however, Syo(f) is larger than 
G(f)Sys(f), so that the noise figure is always larger than unity. The noise 
figure is commonly expressed in decibels, that is, as 10 logioF(f). 

The noise figure may also be expressed in an alternative form. Let Ps(f) 
denote the available signal power from the source, which is the maximum 
average signal power that can be obtained. For the case of a source pro- 
viding a single-frequency signal component with open-circuit voltage 
V, cos(2xft), the available signal power is obtained when the load con- 
nected to the source is Z*(f) = R(f) — jX(f), yielding the value 


all B) 


TAS 
4R(f) 


P5(f) 


(C.10) 


The available signal power at the output of the device is therefore, 


Po(f) = G(f)Ps(f) (C.11) 


Then, mulitplying both the numerator and denominator of the right side 
of Eq. C.9 by Ps(f)By, we have 


_ _Ps(f)Sno( By _ 
FD) = GO PSF)Sys(FYBu 


_ Ps(f)Sno(f)Bn 
Po(f) Sus f)Bw 


= Pf) 


pol f) Ce) 


pocecesocouccnsecosoones 
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where 
ae P) 
ps(f) Suef Bu (C.13) 
pathy = ae (C14 


We refer to ps(f) as the available signal-to-noise ratio of the source and to 
Po(f) as the available signal-to-noise ratio at the device output, both mea- 
sured in a narrow band of width By centered at f. Since the noise figure 
is always greater than unity, it follows from Eq. C.12 that the signal-to- 
noise ratio always decreases with amplification, which is a significant result. 

The noise figure F(f), as defined herein, is a function of the operating 
frequency and hence is referred to as the spot noise figure. In contrast, we 
define an average noise figure F of a two-port device as the ratio of the 
total noise power at the device output to the output noise power due solely 
to the source. That is, 


f Sno(f) af 
aaa aoo (C.15) 
F OPSA af 


It is apparent that in the case of thermal noise in the input circuit with 
R(f) constant, and constant gain throughout a fixed band with zero gain 
at other frequencies, the spot noise figure F(f) and the average noise 
figure F are identical. 


C.3 EQUIVALENT NOISE TEMPERATURE 


A disadvantage of the noise figure F is that when it is used to compare 
low-noise devices, the values obtained are all close to unity. This makes 
the comparison rather difficult. In such cases, it is preferable to use the 
equivalent noise temperature. Consider a linear two-port device with its 
input resistance matched to the internal resistance of the source as shown 
in Fig. C.5. In this diagram, we have also included the noise voltage gen- 
erator associated with the internal resistance R, of the source. The mean- 
square value of this noise voltage is 4kTR,By. Hence, the available noise 
power at the device input is 


NM, = kTBy (C.16) 


612 SYSTEM NOISE AND CALCULATIONS 


Linear 
two-port 
device: 
Noise figure F 


Available Available 
noise power - noise power 
M EREB AE Cea AR 


Figure C.5 
Linear two-port device matched to the internal resistance of a source connected to 


the input. 


Let 43 denote the noise power contributed by the two-port device to the 
total available output noise power «45. We define 43 as 


Ny = GkT,By (C.17) 


where G is the available power gain of the device and T, is its equivalent 
noise temperature. Then it follows that the total output noise power is 


CN EN 
GT + TID. (C.18) 


T 


The noise figure of the device is therefore 


F = — 


Solving for the equivalent noise temperature: 
T, = T(F — 1) (€19) 


where F is the noise figure of the device measured under matched input 
conditions, and with the noise source at temperature T. Equation C.19 is 
the desired relation between the equivalent noise temperature and noise 
figure of a two-port network. 


pa eereaecoscssonsessecee 
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NOISE SPECTRAL DENSITY 


A composite two-port network with equivalent noise temperature T, (re- 
ferred to the input) produces the available noise power 


Noy = kT,By (C.20) 


Hence, recognizing that Mw = N)By, we find that the noise may be 
modeled as white Gaussian noise with zero mean and power spectral density 
N,/2, where 


No = kT, (C.21) 


Note that the power spectral density of the noise so modeled depends only 
on Boltzmann’s constant and the equivalent noise temperature T,. It is the 
simplicity of this model that makes the equivalent noise temperature of a 
composite network such a useful concept. 


C.4 CASCADE CONNECTION OF NOISY NETWORKS 


Consider next a pair of noisy two-port networks with available power 
gains G, and G, that are connected in cascade, as depicted in Fig. C.6. It 
is assumed that the equivalent noise temperatures of the individual net- 
works are T, and 7}, respectively. The total noise power ~; at the system 
output is made up of three contributions: 


1. The source noise power “N, generated at the input of network 1 and 
amplified by both networks: The contribution of ~; to the total noise 
power ~; is 


G,G,4% = G,G,(kTBy) 


where we have made use of the expression for 7, given in Eq. C.16. This 
contribution is represented by the top paths in Fig. C.6. 


Power gain 
G, 


oS 


Network 1 i Network 2 


Figure C.6 
A cascade of two noisy networks. 
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2. The noise power Nx introduced in network 1 and amplified by network 
2: The contribution to ~, produced by Ma is 


G:N = G,( Gk Tı By) 


where we have made use of Eq. C.17, adapted to the situation at hand. 
This contribution is represented by the middle paths in Fig. C.6. 


3. The noise power Mp introduced in network 2: This final contribution 
to the total noise power ~ is 


Nn = G,kT_By 


where again we have made use of Eq. C.17. This contribution is represented 
by the bottom path in Fig. C.6. 


Adding these three contributions, we therefore get 


MN, = GiG MN, + Gi Nan + Nn 
= GiG:(kTBy) + G(GikT,By) + G.kT,By 


GiG(7 aF Ma 3 2), 
G, 


Here we recognize the product G,G, as the overall value of the available 
power gain of the cascaded pair of networks shown in Fig. C.6. Accord- 
ingly, by analogy with Eq. C.18, we may define an equivalent noise tem- 
perature T, for this network as 


T 


T. = T, + Ž 
e il G, 


C2 


The result of Eq. C.22 may be readily generalized to the cascade con- 
nection of any number of noisy two-port networks, as shown by 


Tə T; 
T, =T, +*+ +... ; 
Gee (C.23) 
where T,, T}, T3, . . . are the equivalent noise temperatures of the indi- 
vidual networks, and G,, G2, G;, ... are their available power gains, 


respectively. Equation C.23 is known as the Friis formula. 
Correspondingly, we may express the overall noise figure F of the cas- 
cade connection of any number of two-port networks as 


Fo-1 f1 


F=F,+ 
: Gi G,G, 


oe (C.24) 


where F,, F, Fz, . . . are the noise figures of the individual networks. 
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From Eq. C.23 we see that if the first stage of a cascade connection of 
noisy two-port networks has a high available power gain, then the overall 
value of the equivalent noise temperture T, is practically the same as that 
of the first stage; Eq. C.24 reveals a similar result formulated in terms of 
the noise figure. It is for this reason that we find in a low-noise receiver, 
extra care is taken in the design of the pre-amplifier at the front end of 
the receiver. 


C.5 TELECOMMUNICATION LINK CALCULATIONS 


In this section we present signal and noise power calculations for telecom- 
munication links that rely on line-of-sight propagation through space. Such 
calculations are encountered in a satellite communication system,® for ex- 
ample. In this system, a message signal is transmitted from a ground station 
via the uplink to a synchronous satellite, amplified in a transponder therein, 
and then retransmitted from the satellite via the downlink to another ground 
station. The satellite is positioned in a geostationary orbit (around the earth) 
so that it is always visible to different ground stations located inside the 
satellite antenna’s coverage zones on the earth’s surface. In effect, the 
satellite acts as a powerful repeater in the sky. Another important appli- 
cation is that of a deep-space telecommunication system’ used for the 
transmission of information between a spacecraft and a ground station. In 
this application the system is provided with a tracking capability such that 
the spacecraft is always visible to the ground station. For the analysis 
presented here, we will consider a telecommunication link that is illustrative 
of space applications. Nevertheless, the results of the analysis are equally 
applicable to a line-of-sight radio microwave link between a transmitting 
source and a receiver located a known distance apart. 


CALCULATION OF RECEIVED SIGNAL POWER 


Figure C.7 illustrates a link between a spacecraft and a ground station. 
The link includes a transmitting source (on the spacecraft) with its output 
radiated through the spacecraft’s antenna. At the ground station, a re- 
ceiving antenna is used to collect signal power from the incoming electro- 
magnetic wave and feed it to the low-noise receiver through a piece of 
waveguide. 

Let the transmitting source radiate a total power Pr. If this power were 
radiated isotropically (i.e., uniformly in all directions), then the power flux 
density at a distance r from the source is P;/4zr’, where 4zr’ is the surface 
area of a sphere of radius r. In practice, we use a highly directional antenna 


®For a detailed treatment of link calculations in satellite communications, see Pratt and 
Bostian (1986), Chapter 4. 

7For a detailed treatment of link calculations in deep-space communications, see Yuen 
(1983), Section 1.2. 
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Earth-station 
antenna 


Low-noise 
receiver Output 


Figure C.7 
Space communication link. 


so that the transmitted power is radiated primarily along a particular di- 
rection of interest. The antenna has a gain that is defined as the ratio of 
power radiated per unit solid angle in a given direction to the average power 
radiated per unit solid angle. Let Gr denote the gain of the transmitting 
antenna in the direction in which maximum power is radiated; this direction 
is called the boresight of the antenna. The gain Gy is a measure of the 
increase in power radiated by the antenna over that radiated from an 
isotropic source. Thus, for a transmitter of total power Pr driving a lossless 
antenna with gain Gy, the power flux density at distance r in the direction 
of the antenna boresight is given by 


: (C.25) 


Let A.ş denote the effective aperture area of the receiving antenna. This 
area is related to the physical aperture area A of the antenna by 


Ag = nA (C.26) 


where 7 is the aperture efficiency. Typically, 7 is in the range of 40 to 90%, 
depending on the type of antenna used. The gain of the receiving antenna 
Gr is defined in terms of the effective aperture area A.ş by 


4nA, 
Gp = E (C27) 
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where / is the wavelength of the transmitted electromagnetic wave; A is 
equal to c/f where c is the speed of propagation (which is the same as the 
speed of light), and f is the transmitting frequency. Equivalently, we have 


GR 
== C.28 
ef An ( ) 
Hence, given the power flux density Sat the receiving antenna with effective 
aperture area A., the received power is 


Pr = AgS (C.29) 
Thus, substituting Eqs. C.25 and C.28 in C.29, we get the desired result: 


A 2 
Pr = P;GrGr (4) (C.30) 


Equation C.30 is known as the Friis transmission formula. 

The product P;G; in this equation is called the effective isotropic radiated 
power (EIRP). It describes the combination of the transmitting source and 
antenna in terms of an effective isotropic source with power P;G, radiated 
uniformly in all directions. The term (4zr/A)? is called the path loss or 
space loss; it may be viewed as the ratio of received power to transmitted 
power between two antennas that are separated by a distance r. 

From Eq. C.30 we see that for given values of wavelength 4 and distance 
r, the received signal power Pp can be increased by three methods: 


1. The spacecraft-transmitted power Pz is increased. Typically, Pr is 20 W 
or less. Even though this transmitted power may appear low, the input 
power required for its generation represents a substantial fraction of 
the total power available on the spacecraft. Hence, there is a physical 
limit on how large a value we can assign to the transmitted power Pr. 


2. The gain Gr of the transmitting antenna is increased. This will help 
concentrate the transmitted power more intensely in the direction of 
the receiving antenna. However, a large value of Gr requires the use 
of a large antenna. The choice of G7 is therefore limited by size and 
weight constraints permissible on the spacecraft. 

3. The gain Gr of the receiving antenna is increased. This will enable the 
receiver to collect as much of the radiated signal power as possible. 
Here again, size and weight constraints place a physical limit on the 
size of the ground-station antenna, although these constraints are far 
less demanding than those on the spacecraft antenna; we typically have 
Gr >> Gr- 


Let the receiving antenna gain and the space loss be expressed in decibels 
(dB). Likewise, let the effective radiated power and the received power 
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be expressed in decibels relative to 1 watt (ABW). Then, we may restate 
the Friis transmission formula in the form: 


Pe = EIRP + Ge L; (C.31) 
where 
EIRP = 10 logy(P;Gr) 
Gpr = 10 logu “44 
Ls = 20 loga( 2) 


In Eq. C.30, Gr appears as a power ratio, whereas in Eq. C.31 it is 
expressed in decibels. 

Equation C.31 is idealized in that it does not account for losses in the 
link. To correct for this, it is customary to include a term that represents 
the combined effect of losses in the atmosphere due to rain attenuation, 
losses in the transmitting and receiving antennas, and possible loss of gain 
due to mispointing of the antennas. Let Lo denote the overall value of this 
loss expressed in decibels; this term is sometimes called the system margin. 
Then we may modify the expression for the received signal power as 


Equation C.32 represents a link power budget in that it allows the system 
designer of a telecommunication link to adjust controllable parameters 
such as the EIRP or the receiving antenna gain Gr and make quick cal- 
culations of the received power. 

The received power Pr is commonly called the carrier power. This is 
because in a space communication link the method of modulation com- 
monly used for transmitting message signals maintains the envelope of the 
sinusoidal carrier wave constant; hence, the carrier power is typically equal 
to the received power. 


POPP eee rr ee rrr iiririiitiriiiiiiiririii titi yTyy 


EXAMPLE 2 


A spacecraft is located at a distance of 40,000 km from a ground station 
on the earth’s surface. A transmitting source of frequency 4 GHz radiates 
a power of 10 W through an antenna with a gain of 20 dB. Assume that 
the effective aperture area of the receiving antenna is 10 m°. We want to 
calculate the received signal power, ignoring losses in the links. 


So eeccevcssccessneeneeeeessese 
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The effective radiated power equals 


EIRP 10 logio(PrGr) 
10 logyPr + 10 logor 
10 log 1910 + 20 


30 dBW 


The speed of propagation equals the speed of light: c = 3 x 10° m/s. The 
wavelength of the transmitted electromagnetic wave is therefore 


G 
A = — 
f 
~ 3 Ae 
4x10 
= 0.075 m 
Hence, the space loss equals 
Ls = 29) logo] 
4n x 4 x 10’ 
TEA logo 0.075 
= 196.5 dB 


The gain of the receiving antenna equals 


Gr 


2 


4nA 
10 logu 42 


4n x 10 
10 ogu“ 07 A ; 


= 43.5 dB 


Thus, using Eq. C.32 and ignoring the system margin Lo, we find that the 
received signal power equals 


PP, = 30 +435 = 196.5 


— 123 dBW 


Equivalently, we have 


Pe— > < 10-* watts 
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The low value of power Pp indicates that the received signal at the ground 
station is extremely weak. The inclusion of system margin Lo (to account 
for losses in the link) will make the received signal even weaker. 


CALCULATION OF SYSTEM NOISE TEMPERATURE 


In a space communication link the receiver has to cope with extremely 
weak signals, as illustrated in Example 2; the weakness results from trans- 
mission over long distances. It is therefore imperative that we keep the 
available noise power low so as to permit a high quality of communication. 
From Eq. C.20 we see that the available noise power at the receiver input 
is kKT.By, where k is Boltzmann’s constant, T, is the equivalent noise tem- 
perature of the receiver, and By is the noise bandwidth. Accordingly, the 
effect of noise is minimized by adopting a combination of two independent 
strategies: 


1. The equivalent noise temperature of the receiver is maintained as low as 
possible. An effective way of accomplishing this requirement is to em- 
ploy cryogenically cooled parametric amplifiers. An ordinary amplifier 
converts power from a dc source (e.g., power supply or battery) into 
power at some signal frequency of interest. A parametric amplifier, on 
the other hand, converts power at one frequency (from a source gen- 
erally known as the pump) into power at another frequency, the signal 
frequency. With liquid helium cooling at 4°K above absolute zero, 
parametric amplifiers are able to achieve a noise temperature of 20° to 
40°K at 4 GHz. Another way of providing low-noise amplification at 
microwave frequencies is to use cryogenically cooled maser amplifiers. 
A maser (microwave amplification by the stimulated emission of radia- 
tion) performs amplification by a quantum-mechanical process, adding 
almost no noise to the signal it amplifies. Cryogenically cooled para- 
metric and maser amplifiers, however, are expensive to install and main- 
tain; their use can therefore be justified only in large ground stations. 
Without physical cooling, a noise temperature from 70 to 200°K can be 
achieved by using gallium arsenide field effect transistors (GaAsFET) 
or uncooled parametric amplifiers. 

2. The noise bandwidth is minimized, while still permitting the information- 
carrying (modulated) signals to pass through unaltered. The value used 
for the noise bandwidth By should be the band-pass version of the 
equivalent noise bandwidth. For a rough calculation, we may use instead 
the overall 3-dB bandwidth of the amplifier in the receiver; the error 
introduced by so doing is usually small. 


®For a discussion of parametric amplifiers, see Angelakos and Everhart (1968), pp. 82- 
93. This reference also presents a description of masers (pp. 93-98). 
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To calculate the system noise temperature, we have to include, in addition 
to the noise generated in the receiver, two other sources of noise: 


1. Antenna noise due to random radiation picked up by the ground-station 
antenna. This random radiation includes that from the atmosphere, hot 
bodies in the field of view of the antenna, the omnipresent 2.7°K thermal 
background of the universe, and that portion of the ground seen by the 
sidelobes of the antenna. Let T, denote the antenna noise temperature. 
Let L,, denote the loss factor in the antenna feed and waveguide, where 
L, > 1. Accordingly, the input noise is attenuated by the factor L,,. 
That is, the antenna noise temperature referred to the amplifier input 
equals 7,/L,,. 

2. Noise generated due to resistance in the antenna feed and waveguide: Let 
Tamo denote the ambient temperature. Then the equivalent noise gen- 
erator that represents resistance in the antenna feed and waveguide has 
the noise temperature 


T= ( : +) Te (C.33) 


Note that when there is no loss, L,, is unity and T, is zero. 
Figure C.8 shows the components responsible for noise in the receiving 


system. Let T, denote the system noise temperature referred to the receiver 
input. From Fig. C.8, we see that T, is given by 


T, = 5 F ( = E) Tm T (C.34) 


where, as defined previously, 


T, = antenna noise temperature 
L,, = loss factor in the antenna feed and waveguide 
Tons = ambient temperature of the antenna feed and waveguide 
T, = equivalent noise temperature of the receiver 
Antenna Loss factor Ly > 1 Equivalent 


noise temperature T, Ambient temperature Tamb noise temperature T, 


Figure C.8 
Components responsible for receiving system noise in a space communication link. 
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CARRIER-TO-NOISE RATIO 


- The carrier-to-noise ratio (CNR) is defined as the ratio of the carrier power 


to the available noise power, with both measured at the receiver input. As 
mentioned previously, the carrier power is the same as the received signal 
power Pz. The formula for Pg is described by the Friis transmission equa- 
tion (C.30). To calculate the available noise power at the receiver input, 
we use the expression kT,By, where k is Boltzmann’s constant, T, is the 
system noise temperature, and By is the noise bandwidth. We therefore 
have 


(C.35) 


Here again, the simplicity of this formula stems from the use of noise 
temperature as the measure of how noisy the system is. 


Prey eT CeCe SORE HSO SOO SSOOSETTSTOOSTGATOOSEEHOSO OOO OOTES 
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eee 


EXAMPLE 3 


Consider a receiver with a cryogenically cooled amplifier. The equivalent 
noise temperature of the receiver is 20°K. The ground station uses a large 
antenna operating at a frequency of 4 GHz and an elevation of 5°; the 
antenna noise temperature is estimated to be 50°K. Calculate the system 
noise temperature, assuming no loss in the antenna feed and waveguide. 
Hence, calculate the carrier-to-noise ratio, assuming a carrier power of 
— 123 dBW (as in Example 2) and a noise bandwidth of 36 MHz. 

From Eq. C.34 we see that with L,, = 1 the system noise temperature 
equals 


LSG+T 
5020 
= 70°K 


Hence, the available noise power equals 


kT.By = 1.38 x 10-2 x 70 x 36 x 106 
3.48 x 107“ W 


— 134.6 dBW 


Thus, the use of Eq. C.35 yields the following value for the carrier-to- 
noise ratio expressed in decibels: 


10 logi(CNR) = —123 + 134.6 


11.6 dB 


COCO SOOOSSOHE SESE OSEEEESHSEOGETHO HOOKS ESTSEEEEOEEOSOOS SPOHSSOASEEOEOCEOOHSOOOSESSS SSS OOOSHOSOSESEOOHOOETOSSOCESUSEDEOOES 


APPENDIX D 


In Tables 1 through 8 of Appendix D, we present the following 
material: i 


. Summary of properties of the Fourier transform. 
. Short table of Fourier transform pairs. 

. Table of trigonometric identities. 

. Short table of series expansions and summations. 
. Short table of integrals. 


. List of useful constants. 
. List of recommended unit prefixes. 


CON DMN HP WN 


. Values of the error function erf(u) for u in the range 0 to 3.30. 
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TABLE 1 


Property 


1. 


11. 


12: 


Linearity 


. Time scaling 


. Duality 


. Time shifting 
. Frequency shifting 


. Area under g(t) 


. Area under G(f) 


. Differentiation in the time 


domain 


. Integration in the time 


domain 


. Conjugate functions 


Multiplication in the time 
domain 


Convolution in the time 
domain 


Properties of the Fourier Transform 


Mathematical Description 
ag,(t) + bg,(t) == aG,(f) + bG:(f) 
where a and b are constants 


zas L c(£) 


la| “\a 
where a is a constant 
If = g(t) == G(f), 
thems COES 2-7) 
g(t — t) == G(f) exp(-j27fto) 
exp(j2zf.t)g(t) == G(f z fa 


T g(t) dt = G(0) 
80 = | GU) af 


© a(t) = p2xfG(S) 


{_s@a—= sow + Saw 


If g(t) —= Gf), 
ici 2 0 ———96 (7) 


gia) = | CAGE - 2) da 


F ael - a) de = BNO) 


TABLE 2 Fourier Transform Pairs 
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Time Function 


rect a 
T 


sinc(2 Wt) 


exp(—at)u(t), a>0 


exp(—alt|), a>0 


exp(— zt?) 


t 

| a uN <T 

0, |] = T 
6(t) 
1 
d(t — to) 
exp(j27f.t) 
cos(27f,,t) 


sin(27f.t) 


sgn(t) 
1 


ut 


u(i) 
3, 6¢ - iT) 


i=- 


Fourier Transform 


T sinc(fT) 


a@ + (2nfy 
exp(— xf’) 


T sinc*(fT) 


1 

o(f) 
exp(—j2zft) 
of — f.) 


of — S) + df + fl 


as 
inf 


=j sen(f) 


1 
a OF — f) — of HT] 
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TABLE 3 Trigonometric Identities 
exp(+j0) = cos@ + j sin 
cos? = $[exp(jO) + exp(—jé@)] 


Se z lexp( 8) — exp(-j0)] 


sin’?@ + cos’? = 1 

cos? — sin’? = cos(20) 

cos?@ = 3[1 + cos(26)] 

sin’?@ = 3[1 — cos(26)] 

2 sinf cos? = sin(26) 

sin(a + $) = sina cosf + cosa sinf 
cos(a + $) = cosa cosf = sina sinf 
tana + tanf 

1 ¥ tana tanf 

sina sinf = 3[cos(a — $) — cos(a + £)] 
cosa cosB = 3[cos(a — $) + cos(a + £)] 
sina cosf = 4[sin(a — $) + sin(a + £)] 


SS an cena 


tan(a = py = 
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TABLE 4 Series Expansions and Summations 


1. Expansions 
Taylor series 


f(x) = f@ + 


where 


O g- a) + +O -apto + EO G- ay + 


f(a) = d o 


MacLaurin series 


fa) = 70) + FOr Ons. + PO ng 
where 
po = Se 


Binomial series 
n(n — 1) 2 4 Wen = u = 2) 3 


J 31 se, [nx| <1 


(+x)? =1+nx+ 
Exponential series 


1 2 1 3 
expxy = 1+xt+aex +3 ap c00 


Logarithmic series 
L x) = x= 8x? a a a 


Trigonometric series 


a 1 aa ee A 
sie ate aaga 

il 1 
cosx = 1 —- Thal + g“ — tee 


tanx = x + x + x +: 


aina ek ee a 


fan x a e a =, 8 =[x| = 1 
. ae 
sincx = 1 — 31 0%) “+ zg 0%) = oes 


2, Summations 
Arithmetic series 


Geometric series 
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TABLE 5 _ Integrals 
Indefinite integrals 


f x sin(ax) dx = Z [sin(ax) — ax cos(ax)] 
Í x cos(ax) dx = = [eos(ax) + ax sin(ax)] 
| x exp(ax) dx = = exp(ax)(ax - 1) 


f x exp(ax’) dx = d exp(ax’) 


2a 
f exp(ax) sin(bx) dx = zi — p exp(ax)[a sin(bx) — bcos(bx)] 
Í exp(ax) cos(bx) dx = a -y p exp(ax)[a cos(bx) + b sin(bx)] 


me 
a2 + bx? ab a 


x% dx ee A (8x 
liz +b b b se a 


Definite integrals 


»xsin(ax) , 2% 3 
0 b + x? dx = 5 exp( ab), a>0,b>0 
= cos(ax) , _ 
Cee! Gp ab), a>0,b>0 
= cos(ax) 
o_o dx =p [sin(ab) — ab cos(ab)], a>0,b>0 


[ sincx dx = Í sinc dx = 3 
0 0 


2 1 jx 
eee E= o E 
f ex ax’) dx aaa a>0O 
ie exp(—ax’) dx = Be a>0 
0 4a Va’ 


Integration by parts 


[FOLO a = FOC) - [FOO ae 
where 


fy = 228 


and 


Or ai 


a 
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TABLE 6 Error Function 


u erf(u) u erf(u) 
0.00 0.00000 1.10 0.88021 
0.05 0.05637 1.15 0.89612 
0.10 , 0.11246 1.20 0.91031 
0.15 0.16800 125 0.92290 
0.20 0.22270 1.30 0.93401 
0.25 0.27633 1.35 0.94376 
0.30 0.32863 1.40 0.95229 
0.35 0.37938 1.45 0.95970 
0.40 0.42839 1.50 0.96611 
0.45 0.47548 1.55 0.97162 
0.50 0.52050 1.60 0.97635 
0.55 0.56332 1.65 0.98038 
0.60 0.60386 1.70 0.98379 
0.65 0.64203 1.75 0.98667 
0.70 0.67780 1.80 0.98909 
0.75 « 0.71116 1.85 0.99111 
0.80 0.74210 1.90 0.99279 
0.85 0.77067 1.95 0.99418 
0.90 0.79691 2.00 0.99532 
0.95 0.82089 2.50 0.99959 
1.00 0.84270 3.00 0.99998 
1.05 0.86244 3.30 0.999998 


The error function erf(u) is defined by 
erf(u) = 2 j exp(-z°) dz 
Note that 
erf(0) = 0 
erf(%) = 1 
erf(—u) = —erf(u) 
The complementary error function erfc(u) is defined by 


erfc(u) = =- k exp(—z?) dz 


These two functions are related by 
erfc(u) = 1 — erf(u) 


630 TABLES 


TABLE 7 Useful Constants 


Physical Constants 

Boltzmann’s constant 

Planck’s constant 

Electron (fundamental) charge 
Speed of light in vacuum 
Standard (absolute) temperature 
Thermal voltage 


Thermal energy kT at standard 
temperature 


One hertz (Hz) = 1 cycle/second 
One watt (W) = 1 joule/second 
Mathematical Constants 

Base of natural logarithm 
Logarithm of e to base 2 
Logarithm of 2 to base e 
Logarithm of 2 to base 10 

Pi 


k = 1.38 x 107” joule/degree Kelvin 
h = 6.626 x 10-* joule-second 

q = 1.602 x 10-” coulomb 

c = 2.998 x 10° meters/second 

To = 273 degree Kelvin 

Vz = 0.026 volt at room temperature 
kT, = 3.77 x 10 joule 


e = 2.7182818 
loge = 1.442695 
In 2 = 0.693147 
logio2 = 0.30103 
z = 3.1415927 


TABLE 8 Recommended Unit 
Prefixes 


Multiples and 

Submultiples Prefixes Symbols 
10” tera T 
10° giga G 
10° mega M 
10° kilo k 
10-3 milli m 
10-6 micro u 
10-° nano n 
10°? pico p 


p 
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GLOSSARY 


CONVENTIONS AND NOTATIONS 


1. 


2 


Ila 


i 


13: 


The symbol | | means the magnitude of the complex quantity con- 
tained within. 

The symbol arg( ) means the phase angle of the complex quantity 
contained within. 


. The symbol Re[ ] means the “real part of,” and Im[ ] means the 


“imaginary part of.” 


. The symbol In( ) denotes the natural logarithm of the quantity con- 


tained within, whereas the logarithm to the base ais denoted bylog,(_). 
The symbol exp( ) denotes the exponential function; for example, 
exp(x) denotes e*, where e is the base of the natural logarithm. 


. The use of an asterisk as superscript denotes complex conjugate; for 


example, x* is the complex conjugate of x. 


. The symbol = indicates a Fourier transform pair. For example, let g(t) 


denote a time function and G(f) denote its Fourier transform; we then 
write g(t) = G(f). 


. The symbol F| ] indicates the Fourier transform operation; for ex- 


ample F[g(t)] = G(f). The symbol F~'[ ] indicates the inverse Four- 
ier transform operation; for example F~'[G(f)] = g(t) 


. The symbol € denotes convolution; for example 


r h(t) = f son D 


. The symbol ® denotes modulo-two addition. 
10. 


The use of subscript p indicates that the pertinent function is periodic; 

for example, the function g,(t) is a periodic function of time t. 

The use of a caret (hat) over a function indicates one of two things: 

(a) The Hilbert transform of a function. For example, the function 
&(t) is the Hilbert transform of g(t). 

(b) The estimate of an unknown parameter. For example, the quantity 
&(x) is an estimate of the unknown parameter a, based on the 
observation vector x. 

The use of a tilde over a function indicates the complex envelope of 

a narrow-band signal. For example, the function g(t) is the complex 

envelope of the narrow-band signal g(t). 

The use of subscript + indicates the pre-envelope of a signal. For 

example, the function g (t) is the pre-envelope of the signal g(t). We 

may thus write g,(t) = g(t) + jg(t), where g(t) is the Hilbert trans- 

form of g(t). 
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14. 


15: 


16. 


igs 


18. 


12 


20. 


21. 


22 


23: 


The use of subscripts J and Q denotes the in-phase and quadrature 
components of a narrow-band signal or a narrow-band random process 
with respect to the carrier cos(27f,t). 

The term “baseband” refers to the band of frequencies representing 
the original signal delivered by a source of information. 

In the context of a probability system, © denotes a sample space of 
elementary events, and & denotes a class of events that is a subset of 
the sample space ©. 

Random variables are uppercase (e.g., X or X), whereas sample values 
of random variables are lowercase (e.g., x or x). 

The symbol E[ ] means the expected value:of the random variable 
enclosed within. 

The symbol Var[ ] means the variance of the random variable en- 
closed within. 

The symbol Cov [ ] means the covariance of the two random variables 
enclosed within. 

The average probability of symbol error is denoted by P,. In the case 
of binary signaling techniques, P, denotes the conditional probability 
of error given that symbol 0 was transmitted, and P,, denotes the 
conditional probability of error given that symbol 1 was transmitted. 
The a priori probabilities of symbols 0 and 1 are denoted by p and q, 
respectively. 

The symbol ( ) denotes the time average of the sample function en- 
closed within. 

A boldface lowercase letter denotes a vector, and a boldface uppercase 
letter denotes a matrix. 


FUNCTIONS 


le 


2i 


3) 


4. 


pa | i 
Rectangular function rect(t) = n 2 he 2 
> 2 


Unit step function u(t) = k i z ; 
Signum function sgn(t) = i 
Dirac delta function o(t) = 0, t#0 


F Oe oa 


or equivalently 


f 80 òt- n) dt = g(t) 
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5. Sinc function sinc(x) = so 
TX 
6. Sine intepral Se Í Se 
0 
i 2 
7. Error function erf(u) = —= | exp(-z?) dz 
Vn Jo 
Complementary error erfc(u) = 1 —erf(u) 
function E 


8. Bessel function of the 2 a z a l 
first kind of ordern 7") = 95 he exp(jx sin? — jn0) d0 


ABBREVIATIONS 


ac: alternating current 
ADM: adaptive delta modulation 
APK: amplitude-phase keying 
AWGN: additive white Gaussian noise 
AM: amplitude modulation 
ASK: amplitude-shift keying 
BPF: band-pass filter 
CDMA: code-division multiple access 
CNR: carrier-to-noise ratio 
CPFSK: continuous-phase frequency-shift keying 
CW: continuous wave 
dB: decibel 
dBm: decibel milliwatt 
dBW: decibel watt 
dc: direct current 
DM: delta modulation 
DPCM: differential pulse-code modulation 
DPSK: differential phase-shift keying 
DSBSC:  double-sideband suppressed-carrier 
EIRP: effective isotropic radiated power 
FDM: _ frequency-division multiplexing 
FDMA: | frequency-division multiple access 
FET: field-effect transistor 
FFT: fast Fourier transform 
FIR: _ finite-duration impulse response 
FM: frequency modulation 
FMFB: frequency modulator with feedback 
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FSK: frequency-shift keying 
HDTV: high-definition television 
Hz: hertz 
IF: intermediate frequency 
iid: independent and identically distributed 
ISI: intersymbol interference. 
LMS: least mean-square 
LPF: low-pass filter 
modem: modulator-demodulator 
MSK: minimum shift keying 
NRZ:  nonreturn-to-zero 
NTSC: National Television System Committee ` 
PAM: pulse-amplitude modulation 
PCM: pulse-code modulation 
PDM: _pulse-duration modulation 
PLL: phase-locked loop 
PM: phase modulation 
PN: pseudonoise 
PPM: _ pulse-position modulation 
PSK: _ phase-shift keying 
QAM: quadrature-amplitude modulation 
QPSK: quadriphase-shift keying 
rad: radian 
RF: radio frequency 
rms: root mean-square 
RZ: _ return-to-zero 
s: second 
SLSC: split-luminance and split-chrominance 
SNR: signal-to-noise ratio 
(SNR)c: channel signal-to-noise ratio 
(SNR)o: output signal-to-noise ratio 
SSB: single sideband 
TDM: time-division multiplexing 
TDMA: | time-division multiple access 
TV: television 
V: volt 
VCO: voltage-controlled oscillator 
VLSI: very large-scale integration 
VSB: vestigial sideband 
WSS: wide-sense stationary 
W: watt 
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ANSWERS TO EXERCISES 


Many of the exercises have their answers integrated into them. The answers to the 
remaining exercises are presented below on a chapter-by-chapter basis. 


CHAPTER 2 


Exercise 1: The amplitude spectra have a form similar to the amplitude of a sinc 
function. In case (a), the main lobe will be one-quarter the height and 2.5 times 
the width of that in case (b). : 

Exercise 4: g(t) = 1/(1 — j2zt) = 1/[1 + (2xt)"] + j2rt/[1 + (2nt)] 

Exercise 5: G(f) = (1/2j) [1/(1 + j2n(f — f.)) — 1/1 + j2a(f + f.))] 
Exercise 9: On the left side of the relation, g,(t) is replaced by g(t). 

Exercise 10: On the right side of the relation, G,(f) is replaced by Gž (f). The 
result of changes in Exercise 10 will be the same as those in Exercise 9, as shown 
by fi. gi(t)e*(t) dt = f=. Gf) Gi(f) df 

Exercise 11: Bandwidth = 1/T. 

Exercise 12: Bandwidth = a/2z. 

Exercise 15: cos(2zf.t)u(t) = Fi[jan(f? — fD] + lol — f) + Of taf.) | 


CHAPTER 3 


Exercise 1: The system is noncausal because h(t) is nonzero for negative time. The 

system, however, is stable because f=. |h(t)| dt = f°. exp(at) dt = 1/a. 

Exercise 4: The modification may arise through the use of a phase-inverting am- 

plifier or transformer. 

Exercise 5: [1/H.(f)] = =”__y C, exp(—j2zfm At) where M is some finite in- 

teger. 

Exercise 6: In theory, the delay tọ would have to be infinitely large for the ideal 

low-pass filter to be causal. 

Exercise 8: In-phase component is m(t), and quadrature component is zero. 

Exercise 9: y(0) = Jz. H(f)X(f) df = Je. Re[H(f)X(f)ldf; 90) = 
“= H(f)X(f) df; y(0) = Re[y(O)]. Hence, Re[H(f)X(f)] = Re[H(f)X(f)]. 

The product H(f)X(f) occupies the band f.~ W< f< f. + W for positive 

frequencies, and its image for negative frequencies. On the other hand, the product 

H(f)X(f) occupies the band — W =f < W. With X(0) = 2X(f,), it follows that 

we must have H(0) = H(f,). 

Exercise 10: Phase delay Tp = B(f)/f, where B(f) is the phase. If (f) is constant 

for all f, the phase delay becomes inversely proportional to frequency, and phase 

distortion results. 


CHAPTER 4 


Exercise 4: R,(0) = f=. ¥,(f) df; (0) = f2. R(t) dt 
Exercise 10: Direct procedure: Use the formula for the autocorrelation function of 
the energy signal g(t). Indirect procedure: 1. Compute the Fourier transform G(f) 
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of the signal g(t). 2. Compute the energy spectral density ¥,(f) = |G(f)|?. 
3. Compute the inverse Fourier transform of ¥,(f). 

Exercise 11: Direct procedure: Use the formula for the autocorrelation function of 
the power signal g(t). Indirect procedure: 1. Compute the Fourier transform G;(f) 
of the truncated signal g;(t) for large T. 2. Compute |G;(f)|*. 3. Compute the 
inverse Fourier transform of |G,(f)|. 

Exercise 15: 


A? 25 To 
— 1 ==, a! 
| a 
R) = Af 2 n 
2 1- T 0srtSs 4 
0, for the remainder of the period 


Se (f) = = 3 sine(2) a( - z) 


Exercise 16: Ry(0) = N,/4RC 
Exercise 17: Ry(0) = (No/2) f2. df/[1 + (2xfRC)*] = No/4RC 
Exercise 18: By = 1/(4RC) = 2B/2 


CHAPTER 5 


Exercise 1: Constant 1 

Exercise 2: Number of representation levels = 512 

Exercise 3: Code word length = 9; Bit rate = 75.6 Mb/s; Bandwidth = 75.6 MHz 
Exercise 4: 768 kb/s. 

Exercise 5: 1. Four-level Gray coding. 2. On-off signaling, polar signaling, and 
bipolar signaling. 3. Return-to-zero signaling, and Manchester coding. 

Exercise 6: 6°/3. 

Exercise 7: 


Number of Number of 
Number of Picturephone Television 

System Level Voice Channels Channels Channels 

T1 24 

T2 96 1 

T3 672 7 1 

T4 4032 42 6 
CHAPTER 6 


Exercise 2: 6.312 MHz. 

Exercise 3: 

b, 0 0 1 0 1 1 0 
a; 0 0 0 1 il 0 1 1 
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Polar representation —1 =I =1 +1 aril = Íl ae ap Il 
of a,, volts 

Cp, Volts sa =% 0 +2 0 0 J2 
le, | 2 2 0 2 0 0 2 
pi 0 0 1 0 1 1 0 


Exercise 4: The duobinary technique has correlated digits, while the other two 
methods have independent digits. 
Exercise 5: 


b; 0 0 1 0 1 1 0 
a, 1 1 1 1 0 il 1 0 1 
Polar representation +1 +1 + 1 +) Sal ei eee 
of a,, volts 3 

Cp, Volts 0 M ae 0 hz F2 0 
|c,|, volts 0 0 2 0 2 2 0 
b, 0 0 1 0 1 1 0 
Exercise 6: 

by 0 0 1 0 1 1 0 
a, 0 0 0 0 1 0 0 1 0 
Polar representation -1 -1 — 1-1 41 =1 =e 
of a,, volts 

Ck, Volts 0 0 +2 0 -2 Gre 0 
lc,|, volts 0 0 2 0 2 2 0 
b, o o 1 oO m 
CHAPTER 7 


Exercise 11: The low- and high-frequency ends of the amplitude response of the 
sideband shaping filter are the opposite of those in Fig. 7.24. 

Exercise 13: The wide band 90° phase shifter (Hilbert transformer) of Fig. 7.20 is 
replaced by a filter whose transfer function is defined by Eq. 7.64. 

Exercise 14: f, = fe — fe 

Exercise 15: f;(t) = 5 + 2 cos(4zt), hertz 

Exercise 16: The input of the phase modulator has a triangular waveform. The 
output is the same as the FM wave shown in Fig. 7.37b. 

Exercise 17: Af = 0.2 kHz; $ = 0.2. The carrier frequency f. plays no role in 
these two calculations. 

Exercise 18: The lower side-frequency component of a narrow-band FM wave is 
shifted in phase by 180° compared to that of a standard amplitude-modulated wave. 
Exercise 19: A standard AM contains a carrier of fixed amplitude and two side- 
frequencies. A wideband FM contains a carrier of varying amplitude and an infinite 
number of side-frequencies. 

Exercise 20: For 8 = 0.2, the amplitude spectrum of the FM wave consists essen- 
tially of a carrier at f, and a pair of side-frequencies at fe + fm- 

Exercise 21: B = 130 kHz 

Exercise 22: Mid-band frequency of the filter is 2f,; Bandwidth of the filter is 2B,; 
` where f, is the carrier frequency of s,(¢) and B, is its bandwidth. 

Exercise 23: Af = 60 kHz; $ = 12. Separation of adjacent side-frequencies is 5 
kHz. 
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CHAPTER 8 


Exercise 1: The probability of getting one head and one tail is 1/2 if no distinction 
is made as to which coin turns up head. 

Exercise 2: The probability that the two dice add up to 6 is 5/36. 

Exercise 3: P(A,|B,) = pp)/[ppo + (1 — p)pil; 

P(A,|Bo) = pp,/[(1 - p)po + ppil. 

Exercise 4: (a) P(B) = 4; (b) P(B) = 3; (c) P(Ao|B,) = 1 — 1074; 

(d) Ae, — 1 10% 

' Exercise 5: P(|X — my| < £) = 1 — (oe?) 

Exercise 7: P(— 3 < X < 13) = erf(1/V2) 

Exercise 8: Mean-square value = A? 

Exercise 9; First, o (f) is nonnegative for all f. Second, the total area under the 
curve of o(f) is one. 

Exercise 11: As N becomes large, the power spectral density of the PN sequence 
assumes the same form as that of the corresponding random binary wave. 
Exercise 12: Sy(f) = 4 sin’(xfT)Sx(f) = 42°f?T’S,(f). That is, for low-fre- 
quency inputs, the comb filter acts as a differentiator. 

Exercise 14: f,(x) = 1/(2VnN,W) exp(— x?/4N,W) 

Exercise 15: (a) For the narrow-band random process X(t), Rx(t) = 
2N,W sinc(2 Wt) cos(2zf,7). (b) For the in-phase component X;(t) and quadrature 
component Xo(t): Rx(t) = Rx (t) = 2NoW sinc(2Wr). 


CHAPTER 9 


Exercise 1: (d) When using DSBSC modulation and coherent detection, the trans- 
lated signal sidebands add coherently, whereas the translated noise sidebands add 
incoherently. 

Exercise 4: (SNR)o am = 2pk2P. 

Exercise 5: 11.4 dB 

Exercise 7: The values of threshold channel signal-to-noise ratio are (a) (SNR)c = 
17.8 dB; (b) (SNR)c = 20.8 dB. The corresponding values of average transmitted 
power P, are (a) P, 2 4.5 mW; (b) P, = 9 mW. 

Exercise 8: The power spectral density of de-emphasized noise varies with frequency 
as f?/[1 + (f?/f%)], where fo is the cutoff frequency of the de-emphasis filter. Thus, 
starting at the initial value of zero at zero frequency, the de-emphasized noise 
power spectral density increases with frequency, reaches a peak, and then decreases 
with frequency. 


CHAPTER 10 


Exercise 2: (a) The matched filter output reaches its peak at time t = t + T. 
(b) The maximum value of the output is proportional to signal energy. 

Exercise 6: (a) 4 = 3E; (b) A = (N)/2) In (2) + 2E; 

(c) A = —(N,/2) In (2) + 2E 

Exercise 8: (b) 1.5 dB; (c) 0.68 dB. 
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INDEX 


Absolute temperature, 630 
Adaptive equalization, 250 
adaptation constant, 253 
decision-directed mode, 254 
least mean-square algorithm, 253 
training mode, 253 
Adaptive prediction, 212 
Adaptive quantization, 212 
Aliasing, 181 
Amplitude distortion, 99 
Amplitude modulation (AM), 260 
envelope detector, 272 
envelope distortion, 263 
frequency-domain description, 263 
percentage modulation, 261 
sidebands, 264 
single-tone modulation, 265 
square-law detector, 271 
square-law modulator, 268 
switching modulator, 269 
time-domain description, 261 
transmission bandwidth, 264 
Amplitude-shift keying: 
binary, 369 
detection, 370, 574, 576 
generation, 370 
noncoherent detection, 372 
probability of error, 577 
AM radio, 311 
image signal, 312 
intermediate frequency, 311 
superheterodyne operation, 312 
AM receiver, noise in, 503 
channel signal-to-noise ratio, 503 
figure of merit, 504 
model, 496 
output signal-to-noise ratio, 504 
threshold effect, 506 
AM stereo, 392 
Analog communications, 8 
Analog pulse modulation, 182 
Analog signals, 4 
Angle modulation, 322 
angular argument, 322 
instantaneous frequency, 323 
sinusoidal modulation, 325 
square modulating wave, 326 
types, 323 
zero crossings, 324 


Angular argument, see Phase 
Angular frequency, 23 
Antenna gain, 616 
Antenna noise temperature, 621 
Aperiodic signals, 3 
Aperture effect, 186 
Arithmetic series, 627 
Audio signals: 
studio quality, 196 
telephone quality, 5 
Autocorrelation function: 
energy signals, 138 
periodic signals, 153 
power signals, 147 
random processes, 439 
Available noise power, 606 


Balanced frequency modulator, 347 
Balanced modulator, 276 
Band-limited signal, strictly, 51, 70 
Band-pass transmission, 106 
Bandwidth, signal: 

band-pass, 51 

low-pass, 51 

message, 9, 263 

null-to-null bandwidth, 52 

3-dB bandwidth, 52 


Bandwidth, system, 3-dB bandwidth, 96 
Bandwidth-signal-to-noise ratio tradeoff, 


10, 196 
Baseband, 111, 228 
Baseband data transmission, 228 
channel bandwidth, 235 
ideal solution, 231 
practical considerations, 232 
timing error, 232 
Baud, 247 
Bayes’ rule, 410 
Bel, 597 
Bessel function of first kind, 598 
Binary symmetric channel, 410 
transition probability diagram, 411 
Binomial series, 627 
Bipolar signaling, 197 
Bit, 10, 195 
Bit duration, 228 
Bit rate, 232 
Bit stuffing, 219 
Bolzmann’s constant, 604, 630 
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Burst noise, 603 
Butterworth low-pass filter, 174 


Carrier, 8, 260 
Carrier delay, see Phase delay 
Carrier-to-noise ratio, 505, 622 
Carrier power, 505, 618 
Carson’s rule, 336 
Causality: 

signals, 73 

systems, 90 
Central limit theorem, 428 
Channel capacity theorem, 10, 588 
Channels, 7, 84 

band-limited, 9 

broadcast, 7 

point-to-point, 7 

power-limited, 9 
Chi-squared distribution, 434 
Comb filter, 463 
Coding, 194 

binary code, 195 
Coherent detection, see Detection 
Communication, 2 
Communication system: 

elements, 6 

limitations, 9 

resources, 9 
Companding, 192 

A-law, 193 

p-law, 192 
Complementary error function, 428, 570, 
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Complex envelope, 108 
Complex exponential function, 57 
Compressor, 192 
Conjugate function, 43 
Convolution: 

in frequency domain, 46 

notation, 46 

properties, 79 

in time domain, 49 
Convolution integral, 46, 84 

derivative, 49 

graphical interpretation, 86 
Convolution sum, 89 
Correlation, see Cross-correlation functions 
Correlation coefficient, 579 
Correlation receiver, 373, 563 

generalized two-path, 578 
Correlation theorem, 141 
Correlative coding, 237 

decision feedback, 240 

duobinary signaling, 237 


modified duobinary signaling, 243 
precoding, 241, 245 
Costas loop, 281 
Cross-correlation functions: 
energy signals, 140 
power signals, 149 
random signals, 463 
Cross-spectral densities, 465 


de signal, 56 
Decibel, 52, 94, 597 
Decoding, 200 
Delay distortion, 99 
Delta function, 53 
applications, 56 
Fourier transform, 56 
properties, 54, 79 
replication property, 56 
sifting property, 56 
Delta modulation, 206 
adaptive, 213 
comparison with PCM, 211 
granular noise, 209 
linear, 210 
slope-overload distortion, 209 
Demodulation, 8, 260 
AM waves, 271 
DSBSC waves, 279 
FM waves, 346 
SSB waves, 293 
VSB waves, 303 
Detection, 370, 539. See also Demodulation 
coherent detection, 370, 574 
noncoherent detection, 372, 574 
Deterministic signals, 3 
Dibit, 198, 374 
Differential encoding, 372 
Differential phase-shift keying, 372 
detection, 372, 574 
probability of error, 583 
Differential pulse-code modulation, 202 
adaptive, 212 
comparison with PCM, 211 
prediction gain, 205 
Differentiation in time domain, 38 
Digital communications, 7, 177 
Digital formats, 197 
Digital modulation techniques, 368 
comparison, 586 
Digital pulse modulation, 178 
Digital satellite communications, 382 
Digital signals, 5 
Digital telephony, 215 
Dirac delta function, see Delta function 


Discrete Fourier transform, 71 
inverse, 72 
Discrete-time Fourier transform, 68 
Distortionless transmission, conditions for, 
97 
Double-exponential distribution, 481 
Double-sideband suppressed-carrier 
modulation, 274 
channel signal-to-noise ratio, 498 
demodulation, 279 
figure of merit, 500 
frequency-domain description, 274 
generation, 276 
output signal-to-noise ratio, 500 
quadrature null effect, 280 
single-tone modulation, 280 
time-domain description, 274 
transmission bandwidth, 274 
Duality property of Fourier transform, 33 
Duty cycle, 20 


Einstein—Wiener—Khintchine relations, 148, 


453 
Electron charge, 607, 630 
Energy, 4 
Energy density spectrum, see Energy 
spectral density 
Energy signals, 4 
Energy spectral density, 128 
interpretation, 135 
measurement, 137 
properties, 130 
Envelope, 176, 261 
Envelope delay, see Group delay 
Envelope detection, 272 
Equalization, 100, 186 
adaptive, 250 
Equivalent noise temperature, 611 
Ergodicity, 446 
in autocorrelation function, 448 
in mean, 447 
Error function, 426, 570, 629 
Even part, 77 
Expander, 194 
Expectation operator, 159, 419 
Exponential pulse, 26 
damped sinusoid, 38 
decaying, 27 
double, 30, 80 
rising, 27 
Exponential series, 627 
Eye pattern, 248 


Fast Fourier transform algorithm, 73 
Feedback shift register, 458 
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Figure of merit, 495 
Filters, 84 
finite-duration impulse response, 90 
frequency response, 94 
ideal band-pass, 110 
ideal low-pass, 102, 104, 123, 132 
time response, 84 
Flat-top samples, 182 
Flicker noise, 603 
FM radio, 364 
FM receiver, noise in, 509 
capture effect, 517 
channel signal-to-noise ratio, 514 
compared to PCM, 517 
de-emphasis, 524 
Dolby, 529 
figure of merit, 514 
model, 508 
output signal-to-noise ratio, 514 
pre-emphasis, 524 
threshold carrier-to-noise ratio, 521 
threshold effect, 517 
threshold extension (reduction), 522 
FM stereo, 366 
Fold-over, see Aliasing 
Fourier analysis, 5, 13 
Fourier series, 14 
basis functions, 14 
complex exponential form, 15 
Dirichlet’s conditions, 15 
properties, 75 
real form, 14 
Fourier transform, 20 
Dirichlet’s conditions, 22 
frequency shifting, 36 
inverse, 22 
notations, 23 
numerical computation, 71 
properties, 29, 78 
relation to Laplace transform, 73 
Frequency, 5 
Frequency changing (translation), see 
Mixing 
Frequency modulation (FM), 323 
Carson’s rule, 336 
demodulation, 346 
direct method of generation, 344 
frequency deviation, 327 
frequency sensitivity, 323 
harmonic distortion, 340 
indirect method of generation, 339 
limiting, 363 
modulation index, 328 
narrow-band, 330 
ninety percent bandwidth, 336 
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Frequency modulation (FM) (Continued) 
relation to phase modulation, 324 
single-tone modulation, 327 
transmission bandwidth, 335 
wideband, 332 

Frequency multiplication, 340 

Frequency-shifting property of Fourier 

transform, 36 

Frequency-shift keying, binary, 369 
coherent detection, 370, 574, 580 
generation, 370 
noncoherent detection, 574, 580 
probability of error, 580 

Frequency-shift keying, M-ary, 589 

Frequency synthesizer, 391 

Friis formula for noisy networks, 614 

Friis transmission formula, 617 


Gain, 94 

Gaussian distribution, 425 

Gaussian process, 468 
properties, 469 

Gaussian pulse, 39, 54, 78 

Generalized distributions, 53 

Geometric series, 627 

Gibbs phenomenon, 49 

Gray code, 198 

Group delay, 114 


Hartley modulator, 292 

Hartley oscillator, 344 

Hertz, 630 

Heterodyning, see Mixing 

Hilbert transform, 95 
inverse, 96 


Ideal sampling function, 65 
Imaginary part, 44 
Impulse response, 7 
Integration: 
by parts, 628 
in time domain, 41, 62, 80 
Intersymbol interference, 230 
correlative coding, 237 
ideal solution for, 231 
raised cosine spectrum, 233 
Inverse relation between time and 
frequency, 33, 50 


Kell effect, 315 
Kell factor, 315 


Likelihood ratio, 562 
Limiting, hard, 363 
band-pass, 364 


Linearity, 5, 30, 84 

Linear maximal sequences, see Pseudonoise 
sequences 

Linear modulation, 230, 250, 304, 374 

Line codes, see Digital formats 

Link calculations, 615 

Link power budget, 618 

Logarithmic series, 627 

Log-likelihood ratio, 563 


MacLaurin series, 627 
Manchester code, 197, 594 
M-ary data transmission, baseband, 247 
frequency-shift keying, 589 
phase-shift keying, 589 
Maser, 620 
Matched filter, 543 
design approximations, 553 
pair, 549 
properties, 545 
spectral amplitude matching, 553 
spectral phase matching, 553 
Maximum power transfer theorem, 606 
Minimum probability of error criterion, 562 
Minimum shift keying, 378 
comparison with quadriphase-shift 
keying, 381 
probability of error, 585 
Mixing, 308 
Modulation, 8, 260 
amplitude, 260 
angle, 322 
digital, 368 
linear, 230, 250, 304, 374 
Modulo-2 addition, 458 
M12 multiplexer, 219 
Multipath, 123 
Multiple access, 382 
code-division, 382 
frequency-division, 382 
time-division, 382 
Multiplexing, 8 
frequency division, 309, 390 
time division, 213 
Multiplication in time domain, 45 


Narrow-band filters, 109 
baseband (low-pass) equivalent, 110 
complex low-pass transfer function, 109 
Narrow-band random processes, 471 
envelope and phase components, 478 
in-phase and quadrature components, 
471 
properties, 472 


Narrow-band signals, 106 
complex envelope, 108 
in-phase and quadrature components, 
109 
pre-envelope, 106 
National Television System Committee 
Standards for TV, 316 
Natural (binary) code, 198 
Neper, 94 
Noise, 160, 493, 603 
Noise-equivalent bandwidth: 
band-pass filter, 167 
low-pass filter, 166 
Noise figure, 609 
Noise spectral density, 613 
Noncoherent detection, see Detection 
Nonlinear distortion, 116 
harmonic distortion, 117 
intermodulation distortion, 119 
Nonlinearity, 116 
memoryless, 116, 340 
strong, 341 
weak, 341, 395 
Nonperiodic signals, see Aperiodic signals 
Nyquist bandwidth, 232 
Nyquist interval, 71, 180 
Nyquist rate, 71, 180 


Odd part, 77 
Optimum receiver, 540 
hypothesis testing, 559 
likelihood ratio, 562 
receiver, 563 
log-likelihood ratio, 563 
minimum probability of error criterion, 
562 
probabilistic approach, 558 
signal-to-noise ratio maximization, 541 
Orthogonal signals, 14, 150, 580 


Parametric amplifier, 620 
Parseval’s power theorem, 152 


Partial response signaling, see Correlative 


coding 

Path loss, 617 
Periodic pulse train, 18, 155 
Periodic signals, 3, 14 

ac power, 152 

average power, 152 

dc power, 152 

generating function, 64 

Fourier series representation, 14 

Fourier transform representation, 63 

root mean-square value, 153 
Periodogram, 143 


INDEX 649 


Phase, 322, 478 
Phase delay, 114 
Phase distortion, 99 
Phase-locked loop, 353 
closed-loop transfer function, 358 
first-order, 358 
FM threshold reduction, 524 
frequency demodulation, 358 
hold-in frequency range, 361 
linearized model, 355 
loop parameter, 355 
nonlinear model, 355 
open-loop transfer function, 357 
phase demodulation, 594 
phase-plane plot, 361 
practical considerations, 362 
second-order, 362 
Phase modulation, 323 
relation to frequency modulation, 324 
Phase-shift keying: 
binary, 369 
detection, 370, 574, 579 
generation, 370 
phase error, 595 
probability of error, 580 
M-ary, 589 
Planck’s constant, 604, 630 
Poisson’s. sum formula, 65 
Power, average, 4 
Power ratio, 597 
Power signals, 4 
Power spectral density, 141, 452 
interpretation, 145 
measurement, 146 
modulated wave (process), 143, 461 
power signals, 143 
random signals, 453 


Power spectrum, see Power spectral density 


Prediction filter, 202 
adaptive, 212 
Pre-envelope, 106 
Principle of superposition, 5, 84 
Probability of correct reception: 
average, 585 
conditional, 560 
Probability of error: 
average, 561 
conditional, 560 
Probability theory, 404 
a posteriori probability, 411 
a priori probability, 410 
axioms of probability, 406 
conditional probability, 408 
event, 404 
impossible, 405 
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Probability theory, event (Continued) 
joint, 408 
probability, 405 
joint probability, 408 
relative frequency approach, 404 
sample point, 405 
sample space, 405 
statistically independent events, 410 
statistical regularity, 404 
sure event, 405 
Product modulator, 276 
Pseudonoise sequences, 460 
autocorrelation function, 459 
power spectral density, 460 
Pulse-amplitude modulation, 182 
Pulse-code modulation, 8, 179 
compared: 
with delta modulation, 211 
with differential pulse code 
modulation, 211 
with frequency modulation, 310 
error threshold, 572 
M-ary, 247 
probability of error, 567 
sub-optimum receiver, 573 
Pulse-duration modulation, 182 
Pulse-position modulation, 182 


Quadrature-amplitude modulation, 283, 
Stil, SWS 
Quadrature-carrier multiplexing, see 
Quadrature-amplitude modulation 
Quadrature-modulated process, 464 
Quadriphase-shift keying, 374 
compared with minimum shift keying, 
381 
detection, 378, 575, 583 
generation, 376 
phase error, 596 
probability of error, 585 
Quantizing (quantizer), 187 
dynamic range, 189 
midriser type, 222 
midtread type, 189, 222 
overload distortion, 189 
representation levels, 189 
step size, 189 
Quantizing noise (error), 189 
average power, 190, 422 


Radar, 36 
frequency-modulated, 392 
Radio frequency pulse, 36, 548 

Raised cosine pulse, 74 
Raised cosine spectrum, 233 


Random binary wave, 444 
autocorrelation function, 445 
power spectral density, 456 
Random processes, 3, 158, 403, 434 
autocorrelation function, 439 
autocovariance function, 439 
filtering, 450, 462 
mean, 439 
partial description, 440 
power spectral density, 452 
strict stationarity, 437 
wide-sense stationarity, 440 
Random variables, 414 
conditional probability density function, 
418 
cumulative distribution function, 415 
joint distribution function, 417 
joint probability density function, 418 
probability density function, 416 
square-law transformation, 432 
transformation, one-to-one, 430 
Random vectors, 435 
joint distribution function, 436 
Rayleigh distribution, 480, 481, 507 
Rayleigh’s energy theorem, 128 
Real part, 44 
Received power, 617 
Receiver, 7 
Reconstruction circuit, 186 
Rectangular function, 25 
Rectangular pulse, 24, 31, 35, 54, 546, 548 
doublet, 41 
Regenerative repeaters, 201 
overall probability of error for chain of, 
413 


Sample-and-hold circuit, 182 
Sampling period, 67 
Sampling process, 66, 180 
aperture effect, 186 
instantaneous, 67 
Sampling rate, 67 
Sampling theorem, 70, 180 
Schottky formula, 607 
Schwarz’s inequality, 542 
Scrambler, 390 
Semiconductor junction diode, noise 
model, 608 
Shannon limit, 589 
Shot noise, 606 
Signal, 2 
distortion, 96 
amplitude, 99 
delay, 99 
linear, 96 


Signal energy per bit-to-average noise 
power per unit bandwidth, 586 
Signal-to-noise ratios, 494 
channel, 495 
output, 494 
Signal-to-quantizing noise ratio, 191, 195 
Signum function, 59 
Sinc function, 18 
Sinc pulse, 33, 34, 80, 129, 231 
truncated, 46 
Sine integral, 48, 104 
Single sideband modulation, 284 
channel signal-to-noise ratio, 501 
compared with PCM, 310 
demodulation, 293 
figure of merit, 502 
frequency description, 285 
generation, 286, 292 
output signal-to-noise ratio, 502 
phase distortion, 294 
single-tone modulation, 291 
time-domain description, 288 
transmission bandwidth, 286 
Sinusoidal functions, 58 
Sinusoidal process, 442, 448, 455 
Slope circuit, 347 
Space loss, see Path loss 
Spectral characteristics: 
bandwidth, 51 
_ main lobe, 25 
sidelobes, 26 
Spectrum, 13, 17, 23 
amplitude, 17, 24 
phase, 17, 24 
Spectrum analyzer, 391, 400 
Speed of light, 617, 630 
Spread spectrum modulation, 550 
Square-law detector, 271 
Square-law modulator, 268 
Statistical averages, 419 
characteristic function, 421 
correlation coefficient, 424 
covariance, 424 
mean, 419 
mean-square value, 420 
standard deviation, 420 
variance, 420 


Stochastic processes, see Random processes 
Synchronization in digital communications: 


bit timing, 372 

phase synchronization, 372 
Synchronous detection, see Detection 
System, 84 

amplitude distortion, 99 

amplitude response, 93 
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bandwidth, 96 
causality, 90 
conjugate symmetry, 93 
delay distortion, 99 
frequency response, 91 
impulse response, 84 
linearity, 5, 84 
noise temperature, 621 
phase response, 93 
signal distortion, 96 

_ stability, 91 
time-invariance, 5 


Tapped-delay-line filter, 89, 100, 205, 251 
Taylor series, 627 
Television, 312 
aspect ratio, 315 
bandwidth, 314 
black-and-white, 312 
blanking pulses, 313 
chrominance signals, 318 
chrominance subcarrier, 320 
color, 318 
encoding, 196 
high definition, 320 
line-scanning frequency, 313, 320 
luminance signal, 318 
modulation format, 316 
pixel, 315 
raster scan, 312 
resolution, 314 
Temperature-limited vacuum diode, 607 
Thermal energy, 630 
Thermal noise, 604 
Thermal voltage, 385, 630 
Time-bandwidth product, 52 
Time scaling, 31 
Time shifting property of Fourier 
transform, 34 
T1 system, 217, 236 
Transfer function, 92 
Transmission codes, see Digital formats 
Transmitted power, 9 
Transmitter, 6 
Transversal filter, see Tapped-delay-line 
filter 
Triangular pulse, 41 
Trigonometric identities, 626 
Trigonometric series, 627 


Unbiased estimate, 447 

Uniform distribution, 416 
mean, 422 
mean-square value, 422 
variance, 422 
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Unit impulse, see Delta function 
Unit step function, 26, 61 
Unvoiced sounds, 212 


Varactor, 344 

Vestigial sideband modulation, 295 
demodulation, 303 
frequency-domain description, 295 
generation, 296 
side-band shaping filter, 296 
time-domain description, 299 
transmission bandwidth, 295 

Video signal, 312 


Voiced sounds, 212 
Voltage-controlled oscillator, 344 


Watt, 630 

Wavelength, 617 

White noise, 160, 476 
ideal band-pass filtered, 476, 497 
ideal low-pass filtered, 162 
RC low-pass filtered, 163 
Sinusoidal wave plus, 164 


Zero crossing detector, 353 
Zero crossings, see Angle modulation 


aspin 
SHERRIE tS SE 
Srna 


